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PREFACE 


Technological  advances  have  made  possible  the  development  of  system  capabilities  which  allow  more  effective  weapon 
system  operation  under  difficult  conditions,  such  as  low  altitude,  high  speed,  night  and  all  weather.  Higher  levels  of 
technology  integration  and  combat  automation  are  now  becoming  essential  to  enable  the  pilot  to  accomplish  the  critical 
functions  of  flight  path  control,  threat  management,  navigation,  attack  engagement  and  weapon  system  management. 
Furthermore,  weapon  delivery  and  survivability  are  expected  to  face  further  challenges  from  the  complex  threat  environment 
predicted  for  the  1990s. 


Several  emerging  technologies  are  now  beginning  to  spawn  major  innovations  in  aircratt  design,  through  the  use  of 
combat  automation  concepts.  These  technologies  carry  significant  implications  in  respect  of  pilot  workload,  situational 
awareness,  crew  station  controls  and  displays,  and  automated  system  functions  including  integrity  management.  Effective 
and  efficient  harmonisation  of  this  total  weapon  system,  which  must  also  achieve  the  essential  features  of  pilot  acceptability 
and  safety,  is  critically  dependent  on  the  pilot/vehicle  interface.  This  symposium  sought  to  address  these  critical  issues  of 
combat  automation  and  ?'  •:  man-machine  interface.  In  particular,  it  considered  the  major  implications  and  trade-offs 
involved  in  varying  levels  of  airframe  and  weapon  systems  sophistication  and  such  fundamental  choices  as  that  of  single  seat 
versus  two  seat  operation.  .  ^  .  v.  ,  .  ..  *  .  ' 


Les  progres  technologiques  ont  rendu  possible  le  developpement  de  systemes  capables  dc  rendre  plus  efficace  la  mise 
en  oeuvre  d’un  systeme  d’armes  des  conditions  difficiles  tellcs  que  basse  altitude,  grande  vitesse.  utilisation  de  nuit  et  tous 
temps.  Des  niveaux  supericurs  d'integration  technologique  et  d’automatisation  du  combat  devicnnenl  desormais  essentiels 
pour  permettre  au  pilote  d’accomplir  les  delicates  functions  de  controle  de  la  trajectoire  de  vol,  la  gestion  de  la  menace,  la 
navigation,  l'engagcment  du  combat  et  la  gestion  du  systeme  d’armes.  Plus  encore,  le  largage  des  armements  et  la 
survivabilite  affronteront  davantage  dc  defis  dans  1’environnement  complexe  de  la  menace  prevue  dans  les  annees  1 990. 

L  emergence  de  plusicurs  technologies  commencent  a  multiplier  les  innovations  majeures  dans  la  conception  des 
aeronefs  grace  aux  concepts  d’automatisation.  II  s’agit  plus  particulieremcnt  des  systemes  numeriques  de  bases  de  donnees 
de  la  topographic,  la  commande  vocale,  I’affichage  sur  le  casque,  la  commande  integree  de  vol  et  de  tir.  lassemblage  du 
capteur  multifunction,  les  strategies  de  reconfiguration  et  de  prise  cn  comptc  de  I'erreur  ainsi  que  des  systemes  experts.  De 
tellcs  faciiites  entrainent  des  implications  significatives  concernant  la  charge  de  travail  du  pilote,  la  prise  en  comptc  des 
situations.  I’affichage  et  les  commandes  du  poste  d  equipage  et  Ics  fonctions  automatisecs  v  compris  la  gestion  de  son 
integrite. 

L' harmonisation  effective  et  efficace  de  cc  systeme  d’armes  global  qui  doit  aussi  satistairc  les  normes  essentielles  de  la 
seeurile  et  de  I ’acceptability  du  pilote  est  reellcment  dependante  de  la  relation  homme  machine. 

Ce  symposium  s’est  efforcc  d’aborder  les  problemes  critiques  de  la  relation  combat  automatic  homme-machine.  If  a 
examine  notamment  les  implications  majeurs  et  les  bilans  qui  interviennent  aux  differents  niveaux  de  sophistication  dc  la 
cellule  et  des  systemes  d'armes  et  des  choix  aussi  fondamentaux  que  le  monoplace  oppose  au  biplace. 
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MAN-MACHINE  INTERFACE  -  OPERATOR'S  VIEWPOI NT 


by 

John  R.  Walker 
Air  Vice-Marshal,  RAF 
Deputy  Chief  of  Staff  Operations 
HQ  Allied  Air  Forces  Central  Europe 
Ramstein  Air  Base 
D-6792  Ramstein-Miesenbach  3 


SUMMARY 

Man  is  the  complex  variable  in  the  man-machine  equation.  Already  his  limitations  are 
influencing  aircraft  design. 

As  the  reach,  accuracy  and  lethality  of  modern  weapons  increases,  air  combat  will  be¬ 
come  ever  more  complex  and  gladiatorial.  With  such  a  hostile  environment,  the  man  in  the 
cockpit  will  have  to  be  confronted  with  only  the  best  tactical  information  and  concerned 
only  with  how  best  to  engage  the  enemy;  many  of  the  subsidiary  tasks,  such  as  managing 
the  aircraft  systems,  need  to  be  undertaken  automatically. 

Reliability  and  maintainability  have  a  great  influence  on  the  effective  ratio  of 
forces  and  will  become  increasingly  important  in  the  years  ahead.  Similarly,  new  systems 
should  be  designed  in  their  entirety  for  operations  in  a  hostile  chemical  and  electronic 
environment . 


It  is  a  great  pleasure  and  an  honour  to  be  invited  to  give  the  Keynote  Address  at 
this  AGARD  Symposium,  and  to  start  off  your  week's  deliberations.  Particularly  so  because 
my  association  with  AGARD  in  the  past  has  proved  so  stimulating  and  has  allowed  me  to  meet 
a  group  of  dedicated  engineers  and  scientists  who  are  specialists  in  fields  quite  different 
to  my  own.  For  I  address  you  today  as  an  ’operator’,  not  as  an  engineer.  I  am  the  ’man’ 
in  your  ’man-machine’  interface. 

’Man-machine’  interface  has  become  a  buzz-phrase  and  it  may  be  appropriate  to  start 
the  week's  proceedings  with  at  least  a  quick  examination  of  it.  It  rates  with  'cost- 
effectiveness'  as  one  of  these  frequently  misused  combinations.  Scarcely  a  week  passes 
without  someone  using  'cost-effectiveness'  as  a  synonym  for  'cheap',  or  alternatively 
using  it  to  justify  some  piece  of  equipment  which  patently  does  not  work .  Yet  it  is 
neither  of  these  things.  A  'megabuck'  piece  of  equipment  which  does  something  is  still 
'cost-effective'  compared  to  a  cheap  piece  of  equipment  which  achieves  nothing.  So  it  is 
with  'man-machine'  inteiface  -  it  is  the  sum  of  the  parts  and  we  must  be  ware  of  being  so 
fascinated  by  one  that  we  forget,  or  deliberately  ignore,  the  other. 

There  is  a  strange  contradiction  in  our  man-machine  combination.  One  part  -  the 
machine  -  obeys  laws  and  can  be  explained  by  formulae.  The  other  part  -  man  -  follows 
few  such  logical  laws,  indeed  he  can  be  annoyingly  unpredictable.  He  is  not  even  con¬ 
stant  -  *.hey  are  all  a  combination  of  idiosyncrasies ,  prejudices,  likes  and  dislikes, 
they  do  not  even  come  in  the  same  shapes  and  sizes,  and  their  performance  defies  any 
reliable  measure.  You  might  be  excused  for  complaining  that  if  God  did  indeed  create 
man,  then  he  was  certainly  not  a  qualified  engineer. 

The  men  who  fly  aircraft  are  generally  drawn  from  the  physically  fit  and  the  moder¬ 
ately  intelligent.  In  a  number  of  western  countries  the  demands  placed  upon  intelligence 
are  high-degree  standard  in  many  cases.  Yet  as  demographic  trends  start  to  bite,  and  as 
industry  places  its  legitimate,  and  welcome,  demands  on  the  graduate  market,  the  military 
may  have  to  take  second  place,  not  only  on  the  basis  of  supply  and  demand,  but  as  a 
matter  of  policy  in  the  national  interest.  It  may  take  such  pressures  to  make  us  ask 
ourselves  why  great  academic  capability  is  necessary  to  fly  and  to  fight  an  aircraft 
effectively?  Maybe  it  is  needed  to  produce  a  future  career  officer,  but  it  is  difficult 
to  justify  as  a  necessity  for  flying  an  aircraft.  Give  me  a  16-year-old  who  urgently 
wants  to  fly  fighters  -  and  who  can  ride  a  bicycle  -  and  I  will  produce  a  passable 
fighter  pilot.  Great  academic  ability  is  not  a  pre-requisite  for  a  combat  pilot  as  so 
many  of  the  'aces'  of  the  past  proved  so  convincingly. 

Physical  fitness  certainly  is  a  requirement  and  we  have  probably  reached  the  point 
where  the  curves  cross.  We  have  aircraft  able  to  penetrate  at  600  knots  and  above  and 
which  handle  well  enough  to  be  flown  at  those  speeds  down  to  about  100  feet.  But  not  too 
many  pilots  can  fly  an  aircraft  -  and  use  it  -  much  better  than  600  knots  and  100  feet; 
maybe  the  odd  von  Richthofen-clone  but  not  the  crowd.  The  nine  1 G ’  aircraft  is  also  upon 
us  and  already  ' G ' -induced-loss-of-consciousness  is  raising  its  ugly  head  as  the  two  F-20, 
and  possibly  the  Hawk  200,  accidents  showed  so  tragically.  Yet  there  is  no  reason  why 
the  designer  should  stop  at  nine  'G'  -  the  missile,  after  all,  pulls  40  ’ G ’  or  more  - 
but  he  is  artificially  constrained  while  he  has  to  keep  the  man  in  the  loop.  So  one  of 
the  first  questions  to  pose  -  at  least  in  some  of  the  roles  -  is  why  worry  about  man- 
machine  interface;  why  not  just  remove  the  man? 


Taking  one  step  back  from  that  precipice,  let  us  look  at  the  modern  comb  .t  seen,  . 

The  fi-st  thing  which  should  be  borne  in  mind  is  its  great  lethality,  It  always  has  beer, 
lethal  and  a  look  at  some  of  the  experiences  of  the  World  War  Two  ' Expert en*  puts  the 
point.  Erich  Rudorffer's  kill  races  on  a  number  of  occasions:  eigh*  aircraft  downed  in 
32  minutes,  seven  in  20  minutes  13  in  17  minutes.  Emil  Lang  who  killed  18  in  one  day 
closely  followed  by  Marsielle  vr'  th  17  in  one  day.  Hans  Hahn  who  killed  40  aircraft  in 
only  seven  missions.  All  this  was  with  fixed  forward  firing  guns  and  cannon.  Now,  no* 
only  has  the  close-in  combat  missile  entered  *:he  equation  -  and  missiles  make  'aces'  of 
those  who  gunnery  would  have  weeded  out  -  but  the  Beyond-Visual-Range  (BVR)  battle  must 
be  won,  or  at  least  'survived’  before  Che  classic  high-’C  dogfight  is  entered. 

This  extension  of  the  field  of  battle  out  into  BVR  ranges  has  put  a  new  imperative 
on  ’situational  awareness’  -  another  buzz-phrase  -  but  translated,  means  1 whai -on-earth- 
is-going-on 1 .  If  the  AIM- 54  Phoenix  is  to  be  our  par  then  the  area  of  interest  starts 
as  much  as  100  nautical  miles  ahead  of  the  nose  and  that  is  a  lot  of  sky,  part i cu . ar ly 
in  northwest  Europe  where  on  day  one  of  World  War  Three  there  are  going  to  he  many 
thousands  of  sorties  flown. 

These  ranges  are,  of  course,  way  beyond  visual  perception  and  our  situa’ional  aware¬ 
ness  is  going  to  be  dependent  upon  help  from  sensors.  Raw  sensor  input  would  be  enough, 
to  swamp  our  inadequate  human  operator  and  the  information  may  have  to  be  processed  and 
then  fed  to  him,  carefully,  in  brain-sized  chunks  of  digestible  information.  And  now  we 
start  to  toy  with  what  man-machine  interface  is  all  about.  In  the  modern  cockpit  there 
is  going  to  be  DATA  DELUGE  -  and  there  needs  to  be  -  but  how  can  we  use  it  and  under¬ 
stand  it? 


So,  what  is  this  new  data  deluge?  What  causes  it?  System  complexity  has  something 
to  do  with  it  and  the  difference  is  vast  between  an  F-15  or  Foxhound  on  the  one  hand  and 
a  World  War  One  Fokker  on  the  other.  But  we  must  not  get  so  fascinated  with  the  system 
complexities  that  we  forget  the  tactical  complexity,  for  technology  has  added  so  much  to 
this  area  that  it  could  become  the  dominant  problem. 

For  a  moment  consider  what  aviation  in  its  short  historv  has  done  to  rhe  ’minut  e  V 
In  WorLd  War  One,  two  fighters,  heading  for  each  other,  would  cover  just  four  miles. 

By  the  start  of  World  War  Two  that  had  become  10  miles.  By  Korea,  a  step  increase  to 
17  miles  and  today,  38  miles.  Now  also,  we  have  both  'look'  and  'reach'  to  match  these 
new  'minutes',  indeed  far  more  than  one  minute.  Phoenix  has  hit  in  test  in  excess  of  100 
nautical  miles  -  modern  radar,  particularly  the  big  ones  in  the  larger  fighters,  will 
have  'look' into  this  region  -  well  beyond  visual  range. 

Such  weapon  system  performance,  in  both  'look'  and  'reach',  has  increased  the  area 
of  vulnerability  by  some  orders  compared  to  that  applicable  to  the  fixed  cannon  armament. 
Consider  just  how  much.  An  aircraft  could  be  vulnerable  from  a  Phoenix-type  of  missile  - 
from  all  aspects  -  over  an  area  of  nearly  39,000  square  kilometires.  In  the  early  stages 
of  a  NWE  war  there  could  be  well  over  100  aircraft  in  that  area  -  on  average  -  and  con¬ 
siderably  more  during  periods  of  concentrated  operations.  So  when  we  congratulate  our¬ 
selves  on  our  new  generation  radars  with  track-while-scan  on  20-or-so  targets  we  need  no, 
to  be  too  self-satisfied.  It  still  only  scratches  the  potential  problem,  a  problem  made 
immeasurably  more  complex  by  the  lack  of  an  effective  identification  system. 

Putting  our  eyes  in  the  cockpit  may  not  be  a  healthy  thing  to  do.  History  has  some¬ 
thing  to  say  about  that.  One  study  shows  that  80?„  of  aircraft  Killed  in  combat  did  not 
see  their  attacker.  Another  showed  that  7 0%  of  aircraft  shot  down  had  less  than  30 
degrees  of  bank  on  when  hit.  The  Soviets  believe  that  of  those  aircraft  killed  by  unseen 
assailants,  73%  fell  to  opponents  coming  from  the  vertical  plane.  It  is  easy  enough  to 
imagine  combats,  head-in-cockpit,  against  a  single  opponent  but  this  will  probably  be 
the  unlikely  event.  Multi-aircraft  combats  are  much  more  likely  to  be  the  nerro  and  that 
makes  enormous  demands  on  both  situational  awareness  outside  the  cockpit,  and  system  or 
sensor  interpretation  inside  the  cockpit. 

This  is  a  real  problem.  To  come  alongside  an  aircraft  after  creeping  up  behind  un¬ 
seen  to  find  that  the  pilot,  in  his  360-degree  vision  cockpit,  is  flying  along,  his  head 
bowed  studying  all  those  expensive  devices  designed  to  keep  him  alive,  oblivious  to  your 
presence,  initially  is  amusing  -  then  it  is  sad  -  then  it  is  worrying. 

Some  argue  that  the  answer  is  to  split  the  load  and  to  use  the  two-man  crew.  Up  to 
now  there  have  been  good  performance  reasons  for  retaining  a  single-seat  design  if 
possible.  Fuel,  weight,  added  complexity  and  thei  .by  less  performance.  Now,  when  we  are 
at  the  point  of  nine  'G'  aircraft,  maybe  a  performance  penalty  is  no  longer  a  necessary 
price  to  pay.  Perhaps  the  factor  arguing  against  the  multi-crew  aircraft  now  is  man¬ 
power  costs  -  costs  both  financial  and  in  terms  of  recruiting  and  retaining  sufficient 
high  quality  people. 

Come  with  me  through  some  first  order  mathematics  that  would  be  applicable  to  my 
own  service.  The  average  length  of  aircrew  service  in  the  Royal  Air  Force  is  18.3  years 
of  which  about  one-third  would  be  spent  on  the  front  line.  A  couple  of  years  ago  it  was 
estimated  that  it  cost  about  1.6  million  pounds  to  train  a  navigator.  Take  a  force  of 
100  aircraft  manned  at  an  aircrew-to-aircraf t  ratio  of  1.5-to-l,  therefore  requiring  an 
on-line  force  of  150  navigators.  Over  a  20-year  life  we  need  3000  navigator -man-years 
and  we  get  just  over  six  years  front-line  service  out  of  a  navigator.  The  answer  comes 
out  to  the  need  for  491  navigators  to  make  our  aircraft  two-place. 


Amortising  training  cost  and  pay  and  pensions  we  find  that  the  premium  we  pav  for  two- 
place  could  buy  another  27.5°,  of  aircraft  at  20  million  pounds  each  That  is  an 
impressive  premium  to  pay  for  a  two-place  solution, 

If  we  costed  things  pronerlv  -  not  that  we  do,  bur  if  we  did  -  that  would  give  you 
working  in  -..an -machine  interface  a  handsome  budget  to  solve  the  problem  of  information 
handling  short  of  the  two-man  answer.  You  may  have  to  try  anyway  -  already  we  have  NATO 
air  forces  unable  to  man  their  aircraft  even  to  a  1-to-l  ai  rcrew- to -ai  rcraf  t.  ratio  and 
airline  recruiting  has  yet  to  reach  its  peak,  and  European  economies  are  still  to  emerge 
fully  from  the  recent  depression.  Such  are  the  imperatives. 

So  how  do  we  -  more  correctly,  you  -  go  about  doing  it'  Let  me  give  you  an  oper¬ 
ator's  viewpoint. 

In  my  travels  around  industry  -  and  my  previous  exposure  to  AGARD  -  I  am  impressed 
at  the  quality  of  our  engineers,  scientists  and  designers.  But  I  have  sympathy  with 
them,  because  knowing  what  is  required  in  the  cockpit  of  a  combat  aircraft  if  you  have 
never  been  there  is  difficult,  some  may  suggest  approaching  the  impossible.  Whatever  may 
be  said  for  the  specifications  written  by  operational  requirements  staffs,  the  last  thing 
that  could  be  said  for  them  is  that  they  transmit  the  'flavour'  of  the  environment.  Yet 
I  have  also  been  around  the  operators  on  the  squadrons,  and  a  very  splendid  group  of 
young  men  they  are  too.  But,  how  often  do  we  get  them  together?  Too  often  what  we 
think  is  'liaison  or  'rapport'  between  the  services  and  industry  turns  out  to  be  the 
expense  account  lunch  between  the  Generals  and  Air  Marshals  and  the  Managing  Director. 

I  acceot  that  as  part  of  ’ life ' s-rich-panoply 1 ,  but  it  is  not  the  forum  where  some 
bright  designer  is  going  to  hear  of  an  operational  problem  and  cry  'Eureka'.  That  is 
more  likely  to  happen  over  a  barrel  of  beer  or  some  chipped  coffee  cups.  So  my  first 
suggestion  is  to  get.  the  young  men  Talking  together.  Do  not  forget  how  the  Manchester 
became  the  Lancaster  -  the  designers  went  to  talk  to  the  operators  in  the  field  and  vice 
versa.  There  was  not  a  little  of  the  same  thing  happening  during  the  Falklands  when  no 
British  aircraft  went  to  war  unmodified  in  some  way  or  the  othe- .  Must  we  wait  until 
someone  shoots  at  us  first?  Of  course  riot  -  we  just  need  to  get  the  act  together. 

Whereas  we  can  improve  the  'machine'  part  of  our  interface  these  days  by  adding 
boards  or  chips,  we  have  less  scone  v'th  the  'man'.  Here  we  are  limited  bv  the  Lord's 
somewhat  dated  design  and  if  we  are  to  put  a  great  deal  more  information  into  the  man, 
we  first  need  to  make  room  for  it  -  we  must  reduce  the  load  commensuratel v  elsewhere. 
Where  ? 

The  difficult  part,  of  air  on  rations  should  be  the  'operations'  vit  not  the  'flying' 
'f  the  aircraft.  Yet  currently,  flying  the  aircraft,  and  managing  the  systems,  takes  up 
iust  too  much  time.  In  many  respects  the  man  is  used  merely  as  a  servo-mechanism  and 
that,  these  davs ,  is  a  waste.  Consider  a  tvpical  task.  A  light  comes  or.  to  warn,  say. 
of  low  fuel  pressure  -  the  pilot  refers  to  Flight  Reference  Cards  (if  he  is  of  the  new 
school)  which  tell  him  that  he  throws  a  fuel  cross  feed  switch  and  places  another 
booster  pump  on  line.  Meanwhile  his  head  -  and  more  important,  his  attention  -  is  in 
the  cockpit.  But  why?  Why  does  not  that  original  sensor  throw  the  other  two  switches  - 
more  correctly,  make  the  circuits  -  without  bothering  the  pilot  at  all?  Why  do  we  have, 
in  the  'electric  aircraft',  lengthv  take-off  checklists  requiring  hands  to  flash  about 
the  cockpit  during  a  scramble?  Where  is  the  one  switch  marked  'TAKE  OFF'  whih  sets  up 
'he  aircraft  for  take-off? 

In  current  aircraft  there  are  far  too  many  demands  on  f he  pilot’s  attention  mainlv 
due  to  bad  design  -  or  am  I  being  too  cruel  there  -  let  us  say  'thoughtless'  design. 

Just  take  three  examples:  a  design  in  which  thi  engines  can  quietly  go  into  silent- 
surge  resulting  in  the  aircraft  shelter  floor  having  to  be  swept  clean  -  literally  -  of 
buckets  full  of  turbine  blades.  Another  in  whicn  an  electrical  failure  can  cause  the 
engines  to  overspeed  to  destruction  -  sorting  out  the  electrical  problem  is  not  helped 
by  the  engine  turbine  discs  sawing  off  your  tail  plane!  Yet  another  whose  computer 
control  laws  so  prevented  an  owrstress  that  pilots  could  not  overstress  even  to  avoid 
hitting  t.he  ground  This  sort  of  design  makes  the  human  ser-o-raotor  spend  too  much  of 
his  limited  intelligence  worrying  about  things  which  are  'flight'  critical  rather  'ban 
'mission'  critical.  So,  one  of  your  early  steps  should  ve  to  unload  the  'man'  hit  from 
much  of  its  present  unnecessary  system  management  load. 

Then  we  come  more  to  the  crux  of  the  matter  -  the  cockpit,  or  'office'.  If  indus¬ 
trial  firms  provided  an  environment  for  their  workers  anything  like  some  cockpits,  there 
would  be  strikes  ard  prosecut ions  Indeed,  if  on  1 v  some  animal  rights  organisar ions 
would  make  pets  of  pilots!  But  generally  this  is  in  area  of  progressively  good  news  and 
just  a  little  danger. 

The  good  news  is  that,  the  day  of  the  ergonomic  slum  seems  to  he  over  -  at  least  in 
the  west,  even  if  it  remains  enshrined  in  aircraft  such  as  the  Flogger.  The  slight 
danger  is  that  our  efforts  to  improve  the  cockpit  do  not  go  too  far.  Glass  cockpits, 
mul t i - f unct ion  displays,  head-up  displays  and  the  like  are  all  excellent  in  their  own 
right  but  we  must  be  careful.  We  are  not  talking  of  airliners  in  their  benign  operating 
conditions.  Combat  aircraft  live  a  hard  life  and  must  be  resilient  to  it.  The  cockpit 
environment  has  to  be  looked  a*  not  as  a  series  of  individual  systems  crowded  into  a 
small  place,  but  as  an  integrated  system.  As  engineers  you  may  justifiably  say  "tell  me 
something  new"  But  the  difference  between  your  good  intentions  and  my  front-line  cock¬ 
pit  is  a  mass  of  committees,  financial  parsimony  and  lowest  common  denominators. 


1-4 


We  cend  to  get  a  'consensus  cockpit'  ind  that  tends  to  satisfy  only  ’ consensus -man '  - 
and  he  does  not  exist.  Man  is  a  remarkably  adaptable  creature  -  after  the  first  sortie 
he  will  complain  loud  and  long  -  after  the  fifth  he  takes  it  as  the  natural  order  of 
things  -  he  has  're -programmed'  himself.  He  can  adapt  reasonably  easily  to  the  black  or 
the  white,  but  will  complain  for  years  about  the  greys  which  are  neither  one  thing  nor 
the  other.  So,  a  danger  in  your  business  of  man-machine  interface  is  the  'mu! t i -pi lot  - 
cockpit-committee’ . 

What  we  incorporate  as  new  technology  in  our  cockpits,  however,  must  be  that  which 
is  needed  to  be  there  not  that  which  could  be  there,  ’..'e  must  watch  for  technological 
'circus  tricks'  or  project  manager  'ego-trips'.  Let  me  give  you  a  few  examples  of  those 
circus  tricks  which  cause  me  some  disquiet. 

Let  us  start  with  digitalisation.  Because  we  can  show  things  as  figures,  we  do  so ; 
hence,  our  head-up  displays  are  full  of  them.  And  i f  I  was  an  airline  pilot  -  perish 
the  thought  -  I  would  have  no  argument  with  the  trend.  But  how  do  I  get  RATE  out  of  a 

digital  read-out?  If  I  am  flying  an  aircraft  which  can  go  up  -  or  down  -  by  tens  of 

thousands  of  feet  a  minute,  a  digital  read-out  of  altitude  is  little  more  than  a  meaning¬ 
less  blur;  for  that  I  need  an  analogue  presentation.  In  a  fighter-bomber  -  T,hich  will 
remain  nameless  only  to  protect  the  guilty  -  we  have  a  digital  fuel  presentation;  however, 
not  in  one  single  gauge  but  in  three.  To  find  out  your  fuel  state  you  have  to  read 

three  gauges  -  then  add  them  up.  At  600  knots  and  ICO  feet  with  a  MIG  on  your  tail,  that 

is  the  sort  of  hassle  you  could  do  without.  An  olde-'  -  and  less  expensive  aircraft  - 
had  two  big  clock-like  fuel  gauges.  You  didn't  have  to  'read'  them;  if  the  needles  were 
better  than  11  o'clock  you  were  all  right  -  nine  o'clock  you  wanted  to  know  where  you 
were  landing  -  eight  o'clock  was  the  last  circuit.  One  quick  glance  told  you  your  fuel 
state  -  no  need  for  the  exercise  in  mental  gymnastics. 

Hands-on-Thrott lc-and-Stick  (HOTAS)  must  be  the  norm  rather  than  the  unusual  in  any 
aircraft  capable  of  more  than  a  sustained  six  'G' .  Cockpit  designers  ought  to  have  a 
couple  of  trips  in  a  centrifuge  as  a  matter  of  essential  education.  A  nine  ' G ’  arm  is 
effectively  unusable  unless  it  is  supported. 

A  development  which  does  worry  me  is  the  fascination  with  voice-operated  controls. 
Again,  I  have  no  argument  about  it  in  a  Boeing  747  -  although  why  they  need  voice- 
operated  controls  when  they  have  16  stewardesses  is  beyond  me  -  but  in  combat  how  do  I 
programme  the  computer  to  recognise,  not  my  steely-eyed  crewroom  voice,  but  my  hysterical 
seventh-cctave  garble  when  I  have  spotted  the  SAM  missile  heading  my  way?  We  must  also 
be  very  clear  as  to  what  exactly  is  a  legitimate  command.  Fighter  pilots  under  the 
stress  of  combat  and  high  ’G’  are  renowned  for  their  immoderate,  if  not  even  coarse, 
language  and  if  in  a  moment  of  crisis  they  use  certain  expletives,  there  must  be  a  way 
of  telling  the  computer  that  they  don't  mean  it  to  be  executed  literally! 

We  have  a  long  way  to  go  with  colour.  It  is  said  that  a  picture  is  worth  a  thousand 
words.  Recent  studies  have  proved  that  it  is  worth  much  more.  Colour  can  make  a  pic¬ 
ture  worth  even  more  again  and  its  use  in  two  ways  immediately  springs  to  mind.  The 
obvious  use  -  to  indicate  friendly  is  green,  hostile  as  red,  or  unidentified  as  yellow  - 
can  be  useful  particularly  when  a  complex  air  situation  has  to  be  indicated.  Less 
popular,  perhaps  only  because  we  have  given  insufficient  thought  to  it,  is  the  use  of 
colour  to  indicate  the  timeliness  of  information.  A  plot  of  a  target  derived  from 
memory  or  from  prediction  needs  to  indicate  how  old  is  the  hard  evidence  of  position. 
Changing  the  colour  of  the  presentation  according  to  its  age  can  be  an  excellent  use  of 
colour  and  can  save  the  man  -  the  operator  -  a  considerable  amount  of  mental  anguish. 

In  combat  aircraft  we  have  already  seen  that  keeping  eyes  out  of  the  cockpit  is 
vital.  The  head-up  display  is  a  big  step  in  the  right  direction  -  a  very  good  step  at 
that  -  but  a  'step'  nonetheless.  Although  the  new  holographic  HUDS  have  much  increased 
the  field  of  view,  HUDS  remain  fundamentally  forward-looking  devices.  In  combat,  as 
close  to  a  360-degree  view  as  is  possible  is  required.  Two  information  flows  are  re¬ 
quired:  the  first,  feeding  data  on  targets  into  the  weapon  system  and  the  second, 

feeding  data  from  the  weapon  system  to  the  pilot.  The  answer,  at  least  in  the  immediate 
future,  seems  to  be  Helmet  Mounted  Sights  (HMS) .  It  is  a  matter  ol  amazement  that  so 
little  emphasis  has  been  placed  by  the  requirement  community  on  HMS  when  they  are  quite 
happy  to  contemplate  agile  missiles  with  capabilities  some  way  beyond  the  gimbal  limits 
of  radars.  One  would  seem  to  go  with  the  other. 

This  is  not  to  say  that  there  are  not  problems.  Putting  further  weight  onto  already 
heavy  helmets,  which  have  to  hold  other  devices,  like  Night  Vision  Goggles,  then  having 
it  all  survive  an  ejection,  is  asking  a  lot. 

But  let  us  not  be  so  tunnel-visioned  on  man’s  primary  sensor  -  the  eyes  -  to  the 
detriment  of  the  ears.  When  you  are  looking  ' over-the-shoulder ' ,  aural  messages,  in  the 
form  of  bells,  whistles,  horns  or  whatever,  have  a  lot  to  offer.  Be  careful  with  voice 
warnings.  There  can  be  a  lot  of  radio  traffic  in  a  combat  situation  and  it  must  not  be 
blocket  by  some  seductive  voice  telling  you  that  the  cockpit  temperature  Is  high. 

Let  me  mention  three  practical  engineering  points  of  great  concern  to  the  opera¬ 
tional  commanders. 
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The  first  of  these  are  the  so-called  'ILITIES'  -  Reliability  and  Maintainability. 

I  have  sympathy  with  designers  who  have  to  battle  for  funds  at  the  early  stages  of 
projects,  with  accountants  who  are  more  interested  in  short-term  rather  than  long-term 
budgets.  Li fe-cvcle-costs  have  weighed  too  little  in  the  consideration  of  projects  at 
this  earLv  stage.  As  manpower  becomes  scarce,  training  more  expensive,  and  amortisation 
more  important,  the  reliability  and  maintainability  factor  will  carry  more  weight.  In 
my  own  Ministry  of  Defence,  life-cycle-costs  are  being  talked  about  more  seriously  than 
ever  before  and  I  am  encouraged  by  that,  but  I  sense  that  we  shall  Luvo  in  travel  through 
the  'realisation-gap'  where  it  will  be  unreasonably  expected  that  reliability  and  main¬ 
tainability  will  be  produced  by  exhortation  rather  than  by  conscious  investment. 

Let  me  give  you  just  two  examples  of  why  R  and  M  is  vital.  We  already  have  in  NATO 
aircraft  whi_h  can  be  operated  on  very  long  missions  as  we  capitalise  on  the  heavy  in¬ 
vestment  in  air-to-air  refueling.  The  operational  pay-off  of  such  operations  can  be 
enormous,  allowing  our  numerical  inferiority  against  the  Warsaw  Pact  to  be  partially  off¬ 
set.  But  how  much  sense  does  it  make  when  an  air-to-air  refuelled  mission  time  can  be 
three  twines  the  mean  time  between  failure  of  the  primary  operational  sensor?  Again  we 
return  to  the  necessity  of  looking  at  our  investment  decisions  from  a  total  system  view¬ 
point  rather  than  in  slices  of  the  problem.  Easy  to  say,  difficult  to  do,  < nd  impossible 
to  start  with  a  clean  sheet  of  paper. 

The  other  importance  of  R  and  M  also  falls  from  our  numerical  inferiority.  We  start 
the  northwest  European  air  war  about  2  to  1  down  on  the  Warsaw  Pact.  It  is  vitally 
important  for  us  to  optimise  sortie  rate  in  the  first  couple  of  days  -  and  nights  -  of 
operation.  With  disrupted  bases,  casualties  amongst  our  technicians,  our  clean-air 
avionics  workshops  with  holes  in  them,  and  everyone  looking  at  their  thick  neoprene  gLoves 
through  their  respirators,  that  is  no  time  to  find  that  your  servicing  manual  calls  for 
tweecers  and  micrometers.  Whatever  wonder  mechanism  is  the  light  of  your  life,  there¬ 
fore.  Gentlemen.  IT  HAS  TO  STAY  ON-LINE. 

You  may  wish  to  ponder  whether  you  should  go  for  high  technology  for  its  own  sake. 
Some  time  ago  a  piece  of  Soviet  equipment  fell  into  western  hands.  If  caused  amusement 
amongst  western  technicians  because  of  its  rough  and  rude,  indeed  old-fashioned,  design. 
Their  smiles  were  fixed  by  the  time  it  failed  on  test  after  some  600  hours  -  our  western 
high-tech  version  had  an  MTBF  of  a  little  over  25  hours.  We  have  already  been  through 
the  lesson  -  keen  the  circus  tricks  and  the  technological  ego-trips  for  the  airlines. 

If  the  'warplanes'  break,  we  lose  more  than  profits.  The  military  do  not  want  'aero¬ 
planes'  -  they  need  ‘warplanes'.  If  the  other  side's  ’warplanes '  al low  them  just  a  10' 
better  availability  than  our  own.  and  they  can  keep  them  on  line  for  just  one  more 
sortie  per  due  than  we  can,  then  our  numerical  inferiority  has  just  gone  from  1  to  2 
down  *o  1  to  i  down  in  terms  of  practical  air  operations.  The  highest  pav-off  in  prac¬ 
tice  could  he  putting  hi-tech  to  work  on  the  ’ILITIES'. 

The  second  of  my  final  points  is  somewhat  along  the  same  lines.  When  you  design 
your  ’man-machine'  wonder  kit.  ask  yourself  how  it  will  be  able  to  be  serviced  in  a 
chemical  environment  Easy,  take  it  out  of  the  chemical  environment.  But  what  use  is 
"hat  if  you  have  cooled  it  by  forced  air  ventilation?  You  could  have  persistent'  chemical 
all  over  vnur  boards  and  chips.  It  is  too  convenient  to  neglect  the  chemical  threat. 

Bur.  he  Soviets  have  300,000  tons  of  the  stuff;  it  has  been  used  in  the  I  RAN /IRAQ  war; 
i*  caused  thousands  of  casualties  in  World  War  One  and,  even  then,  it  was  not  new.  In 
1*82  the  Commander  CORIBIT,  during  the  seige  of  Carolstein,  had  2000  cartloads  ol  dung 
catapulted  into  the  town  to  spread  disease  and  pestilence.  And,  as  an  aside,  just  check 
' the  la’est  penetrative  chemical  agents  will  not  ruin  the  insulation  on  your  rniero- 
c i rcui *  s . 


Happily,  mirro-clecironics  do  not  produce  as  much  heat,  and  do  not  need  as  much 
forced-air  cooling  as  did  older  equipment.  But  that  brings  me  to  my  third  and  last  con¬ 
cern.  Electro-Magnetic  Pulse.  We  are  all  aware  of  EMP  as  a  by-product:  of  the  nuclear 
explosion,  hut  -  let  us  be  honest  -  how  seriously  do  we  take  it?  After  all,  if  the 
primary  defence  policy  of  the  west  is  to  use  the  nuclear  weapon  as  a  deterrent:,  that.  is. 
to  make  war  unthinkable  -  by  either  side  -  then  one  cannot  be  too  hard  on  designers  who 
do  not  take  EMP  vulnerability  as  seriously  as  they  might.  But,  the  Soviet  press  are  now 
quoting,  verbatim,  long  passages  from  the  American  press  on  non-nuclear  EMP,  that  is, 
the  means  of  producing  EMP  by  conventional  means.  Western  scientists,  on  the  other  hand, 
claim  that  their  interest  in  the  subject  has  been  sparked  by  scientific  articles  pub¬ 
lished  openlv  by  the  Soviets.  We  might  expect,  a  little  sparing  about  this  sort  of  thing 
but  the  prudent  parent  of  a  new  'man-machine  interface'  idea  might  be  well  advised  to 
make  the  case  out  of  lead  and  not  to  connect  them  all  together  with  wire  -  or  should  we 
suv  in  this  environment  -  aerials. 

So.  in  sum.  what  is  my  operator  message.  The  combat  pilot  is  faced  with  data  deluge 
which,  in  an  increasingly  lethal  air  environment,  is  essential  to  his  survival  -  but  onlv 
i f  he  can  absorb  it.  It  is  going  to  require  a  close  partnership  between  the  operator  and 
the  designer  if  success  is  ro  go  to  the  side  of  the  angels.  But  let  us  not  spend  too 
long  talking  about  it.  For  those  who  have  not  noticed,  the  great  technol ugical  lead  with 
which  we  have  reassured  ourselves  over  the  last  30  years  is  rapidly  being  eaten  away,  in¬ 
dited.  in  some  areas  has  long  since  gone.  We  can.  however,  afford  another  week  -  and  I 
wish  you  all  an  enjoyable  symposium  here  at  AGARD  in  Stuttgart  and  hope  that  someone 
will  go  away  as  a  result  and  eventually  cry  -  'EUREKA'. 
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SUMMARY 

Mission  planning  in  tactical  fighter  operations  is  as  important  today  with  our  highly  integrated, 
software  intensive  aircraft  as  it  was  in  any  tactical  operations  of  the  past.  As  we  move  into  the  next 
generation,  its  importance  will  grow--not  diminish.  The  mission  planner's  task,  whether  performed  by  a 
pilot  or  a  systems  operator,  can  be  made  easier  and  less  susceptible  to  errors  if  designers  understand  the 
planners  task  and  design  to  both  move  the  workload  to  the  planning  room  and  minimize  planning  by  proper 
choice  of  operational  modes  and  aircraft  sensors. 

There  is  a  special  connection  between  planning  requirements  and  the  design  of  the  avionics  suite  to 
include  its  cockpit  layout  in  a  tactical  fighter.  However,  this  relationship  should  not  be  a  simple  func¬ 
tion;  that  is,  we  do  not  wish  to  see  cockpit  workload  decrease  at  the  expense  of  ever  increasing  preflight 
workload.  The  move  should  always  be  to  design  cockpits  and  avionics  suites  that  move  as  many  functions  as 
possible  to  the  preflight  planning  room  thus  easing  the  pilots  inflight  duties  and  allowing  him  to  focus 
his  attention  on  flying  his  craft  and  keeping  abreast  of  the  tactical  situation.  But  a  corollary  to  this 
move  is  one  to  design  cockpits  with  operational  modes  and  sensors  which  will  reduce  the  time  needed  to 
plan  a  mission,  thus  reducing  reaction  time  for  our  tactical  forces. 

This  paper  is  simply  one  man's  opinion  of  the  importance  of  mission  planning,  now  and  in  the  future. 
This  opinion  has  been  formed  over  22-years  of  flying  a  wide  variety  of  tactical  fighters,  running  the 
gamut  of  tactical  operations.  Most  of  this  paper  is  spent  on  what  I  believe  is  the  key  to  both  successful 
mission  planning  and  successful  mission  execution— proper  cockpit  design. 


MISSION  PLANNING:  KEY  TO  SUCCESS 

The  image  of  the  role  of  mission  planning  in  modern  warfare  that  prevails  in  the  minds  of  many  people 

is  more  akin  to  what  they  have  seen  in  movies  like  "Star  Wars"  than  the  actual  c.se.  They  see  fighter 

pilots  scurryiny  to  their  aircraft  with  seemingly  no  preflight  planning  save  for  a  quick  gome  plan  and  pep 
talk  briefing  prior  to  entry  into  a  battle  against  a  complex  and  formidable  enemy.  Mayoe  someday--out  not 
today.  Mission  planning  is  even  more  important  to  today's  fighter  pilot  than  it  was  to  those  first 
aviators  who  took  the  cattle  airborne  in  World  War  I  and  its  importance  is  expandi ng--not  contracting. 

In  the  dawn  of  airpower,  the  fighter  pilot  required  1 i tt ’ •  more  than  a  clear  day  and  a  road  map.  His 
planning  was  simple--a  few  lines  drawn  on  the  map,  pinpointing  of  known  enemy  defenses,  fuel  usaye  com¬ 
putations,  and  target  area  study.  his  most  difficult  planning  task  was  to  "visualize"  how  map  features 

would  appear  in  three  dimensions.  His  craft  was  well  matched  to  this  simple  planning,  having  a  speed  that 
allowed  his  mind  to  easily  keep  pace  with  the  mission  and  a  display  (the  real  world)  which  required  no  new 
interpretive  skills.  As  simple  as  his  mission  planning  seems,  failure  to  accomplish  this  planning  doomed 
the  pilot  to  entering  the  battle  with  little  or  no  situational  awareness.  Success  without  proper  planning 
was  doubtful . 

Employing  the  next  generation  of  fighter  aircraft  will  require  even  more  detailed  planning  than  what 
we  have  seen  in  recent  times.  The  aerodymnamic  efficiencies  of  the  present  and  future  aircraft  coupled 
with  improved  performance  engines  allow  tactical  fighters  to  cover  longer  distances.  A  low-level  mission 
may  easily  require  20  to  3u  steerpoints  which  have  to  be  chosen  and  programmed  into  the  inertial  naviga¬ 
tion  system.  Sophisticated  enemy  defenses  must  be  studied  and  the  decision  made  whether  to  avoid  them  or 
attempt  to  defeat  them. 

As  the  missions  of  fighter  aircraft  have  expanded,  the  dependence  on  human  vision  has  decreased, 
being  displaced  by  raaar  and  infrared  devices.  Such  systems  allow  visibility  beyond  the  capabilities  of 
human  vision,  but  require  an  extra  :tep  in  premission  planning.  where  our  World  war  I  pilots  had  to 
visualize  how  n«jp  features  would  appear  in  the  real  world,  pilots  using  radar  and  infrared  sensors  must 

first  determine  which  features  will  even  be  displayed  and  then  predict  how  they  will  appear.  In  the  case 

of  radar  systems,  the  axis  of  attack  becomes  extremely  important  because  a  target  which  may  be  an  easy  to 
find  radar  target  from  one  direction,  may  be  totally  invisible  from  another.  The  advent  of  synthetic 
aperture  radars  has  helped  significantly  in  radar  interpretation ,  but  has  adoed  new  dimensions  to  the 
planning  task  such  as  the  requirement  for  off-axis  approaches,  that  is,  not  flying  directly  to  the  target 
while  obtaining  the  radar  map.  Infrared  systems  are  very  much  time  of  day  a nl  weather  dependent.  Pilots 

employing  these  systems  must  be  aware  of  possible  thermal  crossover,  tne  point  at  which  an  object  either 

becomes  colder  or  hotter  than  its  background.  High  absolute  humidity  significantly  degrades  the  range  of 
an  infrared  sensor  and  thus  affects  the  type  of  targets  and  turnpoints  the  pilot  should  plan  to  use. 
Additionally,  whereas  the  World  War  I  pilot  had  virtually  unlimited  visibility,  pilots  using  radar  and 
infrared  sensors  look  at  the  world  through  a  window  which  can  only  be  correctly  used  if  detailed  planning 
precedes  the  mission.  Weather  conditions  being  one  of  the  most  unpredictable  planning  factors,  pilots 
must  prepare  for  the  worst,  but  be  able  to  take  advantage  of  improved  conditions.  This  is  especially  true 
in  night  operations  where  both  poor  weather  operations  using  radar  and  clear  weather  or  under-the-weather 
operations  using  infrared  sensors  require  significant  display  prediction. 
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As  the  number  of  sensors  available  to  the  pilot  grows,  the  mission  planner  is  faced  with  a  matrix  of 
trace-offs  which  must  be  considered  as  planning  for  one  system  affects  another.  Mission  success  will  be 
dependent  on  making  the  right  compromises  which  allow  for  near  optimal  use  of  several  systems,  thus 
allowing  them  to  compliment  each  other.  Failure  to  do  this  may  doom  the  mission  to  failure  due  to  an  over 
dependence  on  one  system  vice  another.  For  example,  consider  the  pilot  who  plans  a  mission  using  only  his 
infrared  sensor  without  considering  radar  predictions  in  the  target  area.  If  he  arrives  at  the  target 
shortly  after  a  rain  shower,  he  would  see  nothing  of  infrared  significance  on  his  IR  display,  but  his 
radar  display  might  have  several  strong  returns  any  of  which  could  be  his  target.  Alas,  at  50U  knots  too 
little  time  exists  to  make  sense  of  the  radar  display  without  premission  planning.  7hu.»,  .1  is  clear  that 
proper  mission  planning  considering  all  available  information  remains  an  essential  ingredient  to  mission 
success . 

OF  SIGN  FOR  SUCCESS 

As  our  world  gets  more  complex,  inventors  have  come  up  with  a  plethora  of  labor  saving  devices  which 
populate  our  homes  and  work  places.  As  many  of  us  have  learned,  however,  these  devices  can  become  our 
masters  if  not  properly  integrated  and  controlled  to  allow  life  to  go  on  as  we  want  it.  So  it  can  be  with 
the  present  and  projected  tools  of  the  air  battle.  Choosing  the  right  systems  and  designing  them  with  the 
operator  in  mind,  will  not  only  reduce  his  inflight  and  preflight  workload,  but  allow  him  to  remain  master 
of  his  machine. 

The  Right  System 

The  ideal  situation  for  the  air  battle  commander  would  be  to  have  specialized  weapon  systems  operated 
by  specially  trained  crews  for  each  type  of  mission.  Each  aircraft  would  be  less  expensive  than  a 
multirole  system  because  of  its  limited  capability.  His  pilots  would  be  experts  in  their  mission  because 
they  would  only  have  to  train  for  one  type  of  mission.  Of  course,  this  ideal  force  presupposes  crystal 
ball  knowledge  on  the  part  of  the  commander.  If  his  look  into  future  requirements  turned  out  to  be  less 
than  totally  accurate,  he  could  well  find  himse’f  with  a  ground  attack  force  which  could  not  prosecute  the 
air-to-ground  battle  because  he  had  misjudged  the  size  of  the  air-to-air  force  necessary  to  gain  air 

superiority  over  the  battlefield.  For  very  practical  reasons  then,  all  modern  aii  forces  have  turned  to 
multirole  tactical  aircraft.  These  aircraft  place  great  demands  on  the  pilot  because  of  their  diverse 
mission  capabilities.  The  pitfall  is  that  the  real  air  commander  may  find  himself  in  a  similar  predica¬ 
ment  as  the  commander  in  the  previous  "ideal"  case.  Unlike  the  ideal  commander,  he  always  has  the  right 
mix  of  aircraft,  but  he  may  find  himself  with  the  wrong  mix  of  "expert"  pilots.  Thus,  the  first  tenet  of 
choosing  the  right  weapon  system  is  to  make  it  user  friendly  so  that  an  operator  will  be  competent  in  many 
mission  elements. 

Software  intensive,  integrated  systems  are  ideally  suited  for  the  cockpit  of  multirole  aircraft. 

Software  designers  could  literally  come  up  with  a  routine  for  every  conceivable  mission  and  every  possible 
technique  for  executing  the  mission.  However,  long  before  the  computer  storage  capability  of  even  today’s 
aircraft  has  been  exhausted,  the  gray  matter  in  the  pilot's  head  has  registered  an  overload.  The  trick  is 
to  limit  these  runaway  designs  to  what  we  see  as  viable  requirements.  Military  planners  must  set  these 
limits  because  it  is  not  in  an  aerospace  contractor's  best  interest  to  offer  anything  less  than  everything 
he  can  develop.  The  second  point  then  is  to  limit  the  scope  of  the  multi  role  capability  to  match 
realistic  requirements.  An  example  of  where  I  think  we  are  going  awry  will  illustrate.  At  present,  we 
are  trying  to  give  all  of  our  frontline  fighter  aircraft  first  strike  survi vabil i ty  against  Soviet  type 

defenses.  At  first  glance  this  might  be  applauded  until  we  see  the  cost  of  such  a  decision  and  realize 

that  it  assumes  we  will  not  follow  the  reasonable  tactic  of  rolling  back  enemy  defenses  with  a  specialized 
force  prior  to  conmitting  the  bulk  of  our  fighter  aircraft.  Additionally,  such  a  reliance  on  over-capable 
weapon  systems  fails  to  consider  low  intensity  conflicts.  During  such  situations,  military  tacticians 
will  have  to  weigh  the  economic  feasibility  of  using  and  thus  risking  such  high  cost,  high-tech  weapon 
systems  against  low  cost  targets. 

One  argument  concerning  aircraft  design  is  long  standing  and  directly  bears  on  the  problem  of 
choosing  the  correct  weapon  system.  One  side  of  the  argument  contends  that  the  proper  aircraft  should  be 
a  basic  multirole  airframe  with  an  integrated  avionics  suite  capable  of  accepting  a  large  range  of  strap- 
on  sensors  and  systems.  Their  rationale  is  that  this  is  the  least  expensive  route  and  allows  for  a  more 
rapid  change  of  force  structure  to  meet  a  given  threat.  On  the  other  hand  those  who  favor  fully  imbedded 

systems  are  quick  to  point  out  that  strap-on  systems  tend  to  have  a  significant  impact  on  aerodynamic 

efficiency.  Addi tional ly ,  because  strap-on  systems  are  for  use  on  several  different  aircraft,  they  are, 
at  best,  a  compromise  on  each  aircraft.  Neither  camp  is  totally  correct  in  my  view  because  strap-on 
systems  have  definite  limits  which  may  fall  short  of  the  threat  and  totally  imbedded  systems  (all  aircraft 

equally  capable)  would  cost  too  much.  The  proper  solution  is  a  mix  of  the  two--strap-on  systems  like  the 

Low  Altitude  Navigation  and  Targeting  Infrared  for  Night  (LANTIRN)  system  for  the  bulk  of  the  fleet; 
imbedded  systems  like  the  EF-111  for  specialized  mission  aircraft. 

Any  discussion  of  the  right  weapon  system  would  be  incomplete  if  it  did  not  consider  an  alternative 
to  manned  fiqhter  aircraft.  After  the  Space  Shuttle  Challenger  disaster,  many  people  questioned  whether 
NASA  astronauts  were  unnecessarily  risking  their  lives  doing  tasks  such  as  inserting  satellites  into  orbit 
which  could  have  been  done  much  easier  and  with  no  risk  to  human  life  using  unmanned  launch  vehicles.  In 
like  manner,  military  planners  need  to  consider  the  use  of  unmanned  vehicles  when  the  workload  gets  so 
high  that  the  pilot  becomes  a  passenger,  merely  monitoring  automatic  systems.  Similar  to  the  space 
program,  military  planners  must  decide  when  the  cost  of  putting  a  human  being  at  lisk  exceeds  the  payoff. 

Focus  on  the  Operator 

With  the  strength  of  modern  structures  and  the  speed  and  capacity  of  state-of-the-art  computers, 
there  is  little  doubt  that  the  limiting  factor  in  todays  tactical  aircraft  is  the  pilot.  Most  frontline 
fighters  presently  can  sustain  higher  g's  for  a  longer  period  than  the  man  who  commands  the  machine. 
Likewise  integrated  software  intensive  cockpits  already  display  more  information  than  any  one  man  can 


interpret  and  use.  The  price  we  pay  for  overloading  the  pilot's  g  capability  has  been  demonstrated  all 
too  often  with  a  g-induced  loss  of  consciousness  accident.  Overloading  the  pilot  with  too  much  infor¬ 
mation  in  difficult  to  understand  formats  has  led  to  similar  incidents  due  to  the  pilot  becoming 
disoriented  and  thus  losing  situational  awareness.  The  task  is  to  provide  a  comfortable  cockpit  with  user 
friendly  equipment,  and  built-in,  limited  flexibility. 

Lets  first  look  at  the  pilot's  "office,"  for  cockpit  environment  is  of  utmost  importance  to  efficient 
and  optimum  pilot  performance.  One  way  to  improve  the  cockpit  environment  is  to  reduce  the  amount  of  phy¬ 
sical  work  and  movement  needed  to  operate  the  aircraft  systems.  The  HOTAS  (Hands  on  Throttle  and  Stick) 
switch  mechanization  has  done  a  great  deal  to  ease  the  pilot's  cockpit  workload.  The  movement  toward 
HOTAS  has  to  be  controlled,  however,  or  the  throttles  and  control  sticks  in  the  next  generation  aircraft 
will  be  so  overloaded  with  multi-functional  switches  and  buttons  that  no  pilot  will  be  able  to  remember 
all  the  possible  selections. 

As  cockpit  mechanization  has  improved  over  the  years,  one  area  has  not  received  its  fair  share  of 
attention— cockpit  noise.  Noise  fatigue  is  a  real  phenomenon  which  can  adversely  affect  pilot  perfor¬ 
mance.  In  two  place  aircraft,  the  problem  is  compounded  by  intercom  systems  which  are  frequently  inca¬ 
pable  of  filtering  unwanted  noise.  The  increased  computer  power  in  future  aircraft  will  exacerbate  this 
problem  even  more  since  increased  computer  power  seems  to  go  hand  in  hand  with  larger  demands  for  cooling 
air— a  primary  source  of  cockpit  noise.  New  active  noise  reduction  systems  are  undergoing  tests  now  which 
hopefully  will  alleviate  this  often  overlooked  problem. 

Equipment  designed  with  the  pilot  in  mind  must  be  user  friendly  in  more  ways  than  the  words  imply  for 
desk  top  personal  computers.  It  is  true  that  this  type  of  user  friendliness  is  necessary,  but  the  harsh 
cockpit  environment  requires  consideration  of  display  size,  format  and  controls  along  with  switch  and  but¬ 
ton  design.  Displays  must  be  large  enough  and  clear  enough  that  the  pilot  can  quickly  focus  on  them.  A 
display  whose  information  can  not  be  registered  and  interpreted  at  a  glance  can  be  more  a  hazard  than  an 

aid.  Aircraft  control  suffers  during  any  use  of  such  a  display.  However,  size  is  only  part  of  the 

equation.  Information  must  be  displayed  in  a  format  which  does  not  require  study  to  decipher  its  value. 
If  too  much  information  is  presented  on  a  given  display,  the  pilot  will  have  to  literally  read  the  display 
looking  for  the  needed  information,  regardless  of  display  size.  When  flying  at  1 UO  feet  at  night,  reading 
a  'book"  can  be  deadly,  finally  display  brightness  must  be  easy  to  adjust  with  nominal  default  settings 
for  day  and  night.  There  must  not  only  be  a  balance  among  displays,  but  different  formats  on  a  given 

display  must  also  be  balanced.  This  is  especially  true  when  changing  the  input  to  a  display  from  a  video 

input  like  radar  or  infrared  to  a  text  display  or  vice  versa.  Display  brightness  and  contrast  should  only 
have  to  be  adjusted  once  in  a  given  lighting  situation. 

Workload  in  the  cockpit  can  be  tripled  simply  by  selecting  the  wrong  type  of  controls  the  pilot  must 

use  to  control  his  software  intensive  cockpit.  Touch  sensitive  screens  are  efficient  and  well  suited  for 

the  laboratory  or  simulator  environment,  but  their  suitability  for  operation  in  the  cockpit  of  an  aircraft 
flying  at  1U0  feet  at  night  is  in  question.  If  you  add  the  effects  of  turbulence  which  is  frequently 
found  when  operating  at  low  altitude,  the  problems  associated  with  such  controls  become  more  than  an  occa¬ 
sional  switch  error.  They  drive  the  cockpit  workload  up  to  a  point  that  aircraft  control  is  sacrificed 

for  something  as  simple  as  a  mode  change  of  the  radar  system.  The  pilot  finds  himself  fixing  his  entire 

attention  on  trying  to  place  his  finger  in  a  specific  place  and  touching  that  place  only  once.  Again,  at 
100  feet  at  night  such  fixations  can  be  fatal.  The  solution  is  to  use  controls  which  give  tactile  feed¬ 
back  when  operated.  Keyboards  should  be  designed  with  handbraces  to  allow  operation  in  turbulence  and,  in 
some  cases,  should  allow  for  "blind"  usage  through  the  use  of  various  shapes  and  surfaces. 

As  mentioned  in  the  previous  section,  the  software  intensive  cockpit  is  ideally  suited  to  the 
multirole  aircraft.  The  versatility  which  high  speed  digital  computers  brings  to  the  cockpit  of  even  the 
smallest  fighter  aircraft  is  impressive.  It  allows  for  a  degree  of  flexibility  which  is  hard  to  compre¬ 
hend.  Literally  any  cockpit  set  up  or  mission  profile  can  be  programed  allowing  satisfaction  of  every 
whim  of  every  pilot.  This  flexibility,  however,  breeds  complexity  which  at  best  presents  a  tremendous 
training  challenge  and  at  worst  breeds  confusion  which  may  be  fatal  in  a  low  altitude  tactical  situation. 
One  example  of  this  can  be  found  on  the  early  prototype,  LANTIRN-compatible  F-16  aircraft,  the  original 
version  of  the  Multi-national  Staged  Improvement  Program  ( MS  IP ) .  The  flexibility  which  was  built  in  to 
the  design  allowed  the  pilot  to  have  nearly  any  combination  of  displays  and  system  submodes  availaole  to 
the  pilot  through  his  own  tailored  master  modes.  The  problem  was  that  since  the  system  rememoered  the 
last  pilot's  selections  for  master  modes,  each  pilot  had  to  program  each  possiDle  master  mode  or  risk 
being  surprised  in  the  air  by  a  combination  he  did  not  recognize  and  could  not  use.  The  ultimate  problem 
of  this  flexibility  was  evident  when  the  LANTIRN  system  was  installed.  In  this  case,  a  pilot  who  had 
failed  to  properly  program  his  master  modes  could  easily  lose  his  terrain  following  guidance  due  to  an 
accidental  switch  activation.  The  loss  of  this  guidance  while  flying  at  night  in  the  mountains  at  2UU 
feet  will  cause  the  heart  of  even  the  most  stalwart  pilot  to  miss  a  beat.  Such  an  experience  is  a  rapia 
cure  for  proponents  of  rampant  flexibility.  My  experience  in  operational  fighter  squadrons  is  that  only  a 
small  percentage  of  the  pilots  ever  use  the  flexibility  sew n  into  the  modern  cockpit.  The  average  fighter 
pilot  does  not  want  to  have  to  choose  every  display  combination  and  format  for  each  mode  of  operation. 
Thus,  as  important  as  it  is  to  have  the  right  amount  of  flexibility  built  into  the  software  intensive 
cockpit,  it  is  even  more  important  that  well  thought  out  default  formats  be  available  for  each  mode,  for¬ 
mats  which  will  automatical ly  be  displayed  upon  initial  power-up  if  the  pilot  has  taken  no  action  to 

change  them.  Additionally ,  there  must  be  an  easy  way  to  get  back  to  these  default  modes  if  in  the  heat  of 
battle  the  confusion  factor  becomes  so  high  that  the  pilot  wants  to  get  bacx  to  basics  quickly.  In  sum, 
make  the  flexible  cockpit  a  pilot  option  not  a  mandatory  planning  task. 

Finally,  keeping  the  pilot  in  mind  during  cockpit  design  means  unloading  cockpit  duties  to  the 
planning  room.  The  beauty  of  the  software  intensive  cockpit  is  that  with  a  simple  interface  all  flight 
planning,  whether  it's  navigation  planning,  threat  planning,  or  delivery  planning,  can  be  completed  away 
from  the  cockpit  and  loaded  into  a  small  cassette  for  transfer  to  the  aircraft  computers.  Planning  and 
data  entry  can  be  completed  in  the  quietness  and  comfort  of  an  office  environment  with  all  available  tech¬ 
nical  data  within  easy  reach.  Entries  can  be  quickly  checked  and  double  checked  to  eliminate  keyboard 
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error*  which  could  easily  turn  a  successful  mission  into  a  confusing  failure  when  hastily  typed  target 
coordinates  later  proved  to  oe  in  error.  Such  data  transfer  units  are  in  use  now  ana  their  use  shoulu  oe 
expanded.  Threat  data  from  the  intelligence  branch  should  be  included  'so  that  the  latest  information  on 
enemy  defenses  is  displayed  on  the  digital  nap  presentation.  Moving  data  entry  from  the  cockpit  to  tne 
planning  room  allows  the  pilot  to  concentrate  on  his  primary  task  of  flying  the  mission. 

In  summary,  designing  for  success  in  the  next  generation  of  tactical  fighters  must  start  by  choosing 
the  right  systems  and  then  remembering  the  limitations  of  the  human  tor. 

MAYBE  SOMEDAY 

Mission  planning  continues  to  be  the  key  to  mission  success.  With  proper  system  design,  we  can  mini¬ 
mize  the  workload  of  both  the  pilot  in  the  aircraft  and  the  pilot  in  the  planning  room.  We  can  even 
transfer  some  of  the  pilots  preflight  planning  to  "others,"  but  mission  planning  will  always  be  with  us  in 
some  form. 

Perhaps  someday  as  the  mission  commander  oriefs  his  pilots  on  the  details  of  their  mission  prior  to 
stepping  to  their  aircraft,  his  words  will  be  "heard"  by  a  voice  activated  computer  which  will  change  his 
briefing  into  individual  fully  planned  profiles  for  each  pilot.  The  computer,  which  is  constantly  updated 
with  weather,  intelligence  and  tactics  information,  plans  the  profiles  based  on  its  near  perfect  knowledge 
of  weapon  arid  system  capabil i ties.  Attack  routes  are  chosen  to  bypass  defenses  or  to  defeat  them  if  the 
capability  exists  within  the  mission  aircraft.  Since  the  computer  does  all  the  planning  for  this  strike 
force  and  interfaces  with  all  other  mission  planning  computers,  conflicts  in  attack  routes  are  eliminated. 
After  the  commander  completes  his  briefing,  each  pilot  picks  up  his  cassette  containing  all  the  data 
needed  to  complete  the  mission. 

Once  airborne,  the  pilot  is  presented  with  a  briefing  approaching  each  turnpoint  by  the  aircraft 
central  computer  through  voice  and  graphics  describing  the  charcteristics  and  any  dangers  associated  with 
the  turnpoint.  Approaching  the  target  area  a  similar  refresher  from  the  mission  briefing  is  given  along 
with  any  updated  information  about  threats  received  through  on  board  sensors  or  down-linked  from  airborne 
surveillance  platforms. 

Throughout  the  mission,  the  pilot  is  constantly  fed  information  to  help  him  fly  the  mission  safely 
and  successfully.  This  information  is  presented  to  him  in  the  easiest  to  interpret  formats  for  human 
beings:  voice  and  pictures.  Mission  success  Is  practically  guaranteed.  Sound  like  Star  Wars?  Yes. 

Well  maybe  someday--but  not  today. 
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SUMMARY 

The  biodynamic  effects  of  high  speed  flight  can  produce  sudden  loss  of 
consciousness  without  warning  whereas  most  aircrew  are  used  to  the  prodromal  loss 
of  vision.  New  advances  in  anti  G  systems  design  can  improve  G  tolerance  but 
training  is  foreseen  as  the  short  term  answer  to  this  problem.  Later  aircraft 
will  use  pressure  breathing  and  improved  garments  as  these  alone  offer 
substantial  gains  in  G  tolerance. 

Amongst  the  environmental  stresses  that  limit  performance  are  thermal, 
vibration,  noise  and  NBC  defence.  Personal  conditioning  is  of  benefit  under  high 
thermal  stress,  active  noise  reduction  can  limit  the  reduct  ion  of  noise  at  the 
ear  and  NBC  defensive  ensembles  protect  against  NBC  agents.  Much  remains  to  be 
achieved  in  the  field  of  vibration  attenuation. 

The  design  of  the  man  machine  interface  can  both  enhance  and  detract  from 
crew  performance  in  flight.  Head  up  displays,  night  vision  goggles,  helmet 
mounted  displays,  computer  graphics,  digital  maps  and  integrated  sensor  displays 
can  be  viewed  as  new  features  which  greatly  increase  mission  capability.  The 
requirements  for  audio  recognition  of  electronic  threats  and  the  use  of  colour 
are  areas  which  can,  if  used  unwisely,  mitigate  against  crew  efficiency. 

Finally,  cockpit  and  system  automation  offers  the  chance  of  significant 
advances  in  cockpit  design  as  management  tasks  can  be  completely  relegated  r.o  the 
electronic  crew  member,  leaving  the  human  as  the  ultimate  decision  maker  involved 
only  when  absolutely  necessary. 

INTRODUCTION 

There  can  be  little  doubt  th*.t  man  will  continue  to  crew  combat  aircraft 
well  into  the  future.  Remote  piloted  vehicles  have  been  with  us  for  some  time 
but  their  utility  can  be  measured  in  terms  of  their  limited  growth  in  numbers. 
Battlefield  surveillance  in  VMC  is  perhaps  one  area  where  they  have  much  to 
offer.  In  all  other  conditions,  the  inclusion  of  the  human  computer  is  seen  as 
the  most  cost  effective  payload  in  combat  aircraft  despite  the  limitations  of  the 
crew  in  advanced  combat  and  high  threat  environments. 

This  paper  will  examine  some  of  the  human  limitations  in  flight  and  some 
possible  remedies  as  a  guide  to  designers  who  have  a  significant  role  in  the 
sophistication  of  the  man  machine  interface. 


BIODYNAMICS 

The  principal  hazard  for  limitation  of  performance  is  the  haemodynamic 
effect  of  the  sudden  or  rapid  application  of  acceleration  forces  on  the  crew 
consequent  upon  rapid  manoevres  which  change  flight  path  vectors.  The  belief 
that  the  more  manoeuverable  the  aircraft  the  less  vulnerable  it  is  to  hostile 
action  has  bred  a  new  generation  of  high  performance  aircraft  which  have  large 
thrust  weight  ratios  and  high  manoeuverabi 1 ity .  In  fact,  some  of  the  newer 
aircraft  are  designed  to  be  inherently  unstable  in  flight  so  that  the  response  to 
the  manoeuvre  is  enhanced.  These  aircraft  require  computer  control  to  guarantee 
stable  flight  at  all  times. 

The  cardiovascular  demands  of  high  sustained  acceleration  (C»)  forces  limit 
human  performance  because  when  the  perfusion  of  the  eye  and  brain  fails,  sight 
and  consciousness  are  lost.  This  problem  has  been  realised  since  the  192ns  and 
many  protective  measures  are  now  incorporated  in  aircraft  systems.  However, 
within  the  last  few  years  an  added  hazard  had  found  prominence  which  concerns  the 
rate  of  application  of  the  acceleration  rather  than  the  level  of  acceleration 
itself.  Figure  1  shows  human  tolerance  to  applied  positive  vertical  acceleration 
( +Gz )  with  respect  to  time.  The  more  gradual  rate  of  application  (line  x)  shows 
that  there  is  a  warning  area  (cross  hatched)  where  sight  is  impaired  before  the 
loss  of  consciousness  (G  -  LOC) ,  This  is  because  although  the  eye  and  brain  are 
at  a  similar  level  above  the  heart,  the  intra-global  pressure  of  the  eye  causes 
orbital  blood  perfusion  to  fail  before  that  of  the  brain.  Thus  the  pilot  knows 
that  when  his  vision  dims  or  colour  perception  is  impaired,  loss  of  consciousness 


is  not  far  behind.  However,  when  the  rate  of  application  of  G  is  high  (line  y), 
the  warning  zone  of  loss  of  vision  (grey  out)  is  absent  and  the  pilot  looses 
consciousness  without  any  warning.  This  loss  of  consciousness  has  a  mean  time 
course  of  15  seconds  because  although  the  manoeuvre  demand  from  the  pilot,  ceases 
when  he  loses  consciousness,  it  still  takes  some  time  for  the  aircraft  to  change 
its  flight  path  and  for  the  blood  pressure  to  recover  sufficiently  to  restart 
perfusion  in  the  brain.  At  any  flight  level  this  loss  of  consc musness  is 
unacceptabl e .  At  low  level  it  is  fatal. 

Both  the  USAF  and  the  RAF  have  surveyed  their  aircrew  to  determine  the 
frequency  of  these  occurrences.  Both  the  USAF  (Pluta,  1984)  and  the  USN 
(Johanson  and  Terry,  1986)  found  that  12-14%  had  experienced  one  or  more 
episodes  of  unconsciousness  in  flight  and  m  one  high  performance  aircraft,  the 
F-16,  the  incidence  rose  to  10%.  Prior  (1987)  found  in  the  RAF  that  19%  reported 
at  least  one  episode  of  G-LOC  and  that  the  majority  occurred  m  jet  aircraft  of 
modest  performance  (trainers)  where  no  anti  G  system  was  provided.  He  also 
reported  prolonged  recovery  times  in  many  incidents  with  a  variety  of  symptoms 
reported.  The  USAF  have  attributed  several  fatal  aircraft  accidents  due  to  G-LOC* 
and  all  western  Air  Forces  are  actively  pursuing  methods  of  enhancing  G 
protection.  The  USAF  and  other  NATO  Air  Forces  use  centrifuge  training  as  the 
experience  of  G-LOC  under  controlled  conditions  plays  a  vital  role  in  its  later 
avoidance.  The  centrifuge  experiences  enable  aircrew  to  watch  their  performance 
on  video,  to  refine  their  anti  G  straining  manoevres  (AGSM)  which  can  he  further 
developed  in  flight. 


Some  new  developments  to  counter  the  hazards  of  G-LOC  are  as  follows: 

It  has  been  shown  that  the  higher  inflation  pressure  schedules 
(eg  p=1.25  Gn  -  1)  do  provide  enhanced  G  protection  but  when  severe 
discomfort  is  produced,  systemic  blood  pressure  and  hence  G  tolerance 
is  reduced.  The  USAF  ready  pressure  valve  which  pre-mflates  the  suit 
to  0.5psi  produces  improved  G  tolerance  as  the  time  to  full  inflation 
is  reduced.  Gas  flow  times  can  be  further  reduced  by  electronic  servo 
valves  which  have  the  great  advantage  of  being  easily  programmable  as 
manoevre  demands  change.  However,  these  valves  have  yet  to  show 

improved  G  tolerances.  The  pulsatile  types  of  valve  ("bang-bang" 

Albery  et  al,  1987)  have  demonstrated  improved  G  tolerance  but  only  as 
far  as  the  mean  pressure  is  increased  relative  to  steady  state  values. 
Perhaps  the  non-linear  valves  (Cammerota , 1 987 )  now  under  development 
may  show  improvements  in  G  tolerance  which  have  evaded  other  designs. 
Although  it  might  be  considered  that  early  or  even  pie- i nf lat ion  of  the 
anti  G  suit  might  enhance  G  tolerance,  experiments  have  failed  to 
demonstrate  any  improvement  with  these  schemes. 

The  suit  which  applies  counter  pressure  to  the  abdomen  and  lower  limbs 
has  seen  few  radical  changes  of  late.  The  suit  works  by  increasing 
peripheral  vascular  resistance  in  the  areas  covered  which,  in  turn, 
elevates  the  systemic  arterial  pressure  to  permit  perfusion  of  the  head 
under  applied  positive  vertical  acceleration.  Basically,  the  garment 
comprises  an  inflatable  bag  supplied  with  gas  under  the  control  of  anti 
G  valve  with  the  bladder  tailored  for  comfort  and  movement.  The 
internal  anti  G  suit  worn  next  to  the  skin  and  undergarments  works  best 
as  there  are  fewer  compressible  layers  between  the  suit.  and  the 
arterial  tree.  However,  this  makes  for  difficulty  in  doffing  the 
garment  between  flights  hence  the  development  of  an  external  garment. 
This  is  worn  over  the  coverall  and  corporates  the  pocketry  and  other 
external  features  of  that  garment.  There  are  small  but  demonstrable 
differences  between  the  protection  of  the  internal  and  external  suits 
but  most  aircrew  have  made  the  choice  of  the  external  suit  on  comfort 
and  ease  of  use.  Extending  the  coverage  of  a  garment  may  improve  the 
protection  somewhat  but  at  the  risk  of  worsened  comfort.  Tn 

particular,  the  extension  of  coverage  to  the  buttocks  may  well  reduce 
comfort  under  the  lap  restraint  straps  as  the  pelvis  is  elevated  by  the 
expanded  buttock  bladder. 

One  of  the  more  significant  improvements  in  G  tolerance  has  come  from 
an  increase  in  breathing  or  int rathorac  ic  pressure  when  G  forces 
increase.  The  anti  G  straining  manoevres  that  pilots  are  taught 
increase  the  intrathoracic  pressure  which  increases  the  arterial 
pressure  as  a  whole.  However,  this  can  be  fatiguing.  The  pressure 
breathing  valves  that  are  necessary  to  maintain  tissue  oxygenation  at 
altitudes  above  40,000  ft  can  be  adapted  to  become  acceleration 
sensitive  so  that  they  increase  breathing  pressure  when  G  is  applied. 
Recent  experiments  using  these  techniques  have  shown  not  only  a 
considerable  reduction  in  fatigue  but  also  a  considerable  enhancement 


of  G  tolerance.  The  changes  in  the  chest  wall  size  can  be  minimised 
by  counter  pressure  garments  such  that  gas  is  applied  not  only  to  the 
anti  G  suit  but  also  to  a  similar  garment  worn  over  the  chest.  The 
pressure  gradients  between  anti  G  suit,  pressure  breathing  and  the 
chest  counter  pressure  garments  can  be  varied  to  select  the  optimal  G 
tolerance.  Speech  difficulties  can  be  minimised  with  training  under 
such  regimes  and  the  enhanced  G  tolerance  more  than  compensates  for 
these  disadvantages. 

As  perfusion  in  the  head  under  +Gz  is  an  inverse  function  of  the 
distance  of  the  head  above  the  heart,  reduction  of  the  head  to  heart 
distance  by  reclining  the  aircrew  seat  rearwards  or  even  forwards 
(prone)  will  enhance  G  tolerance.  Rearwards  reclination  provides  a 
more  comfortable  position  as  a  sitting  position  is  achieved  with  all 
body  weight  including  the  head  being  supported  by  the  seat.  A  prone 
lying  position  can  reduce  the  head  to  heart  distance  to  zero  but  at 
considerable  ergonomic  disadvantages  in  the  positioning  of  controls  and 
displays  and  the  much  reduced  fields  of  external  vision.  The  reclined 
sitting  position  also  restricts  rearward  vision  somewhat  as  a  high 
degree  of  tilt  is  necessary  to  provide  significant  G  tolerance 
improvement . Furthermore ,  both  prone  and  reclined  positions  introduce 
new  problems  of  assisted  escape  in  the  security  of  the  ejection  path 
and  successful  escape  path  clearance.  It  is  for  these  reasons  that  few 
aircraft  either  in  service  or  projected  use  extensive  reclination  or 
prone  positions  as  ways  of  enhancing  G  tolerance. 

The  problem  of  G-LOC  at  low  altitudes  and  the  need  for  adequate  ground 
clearance  at  all  times  has  prompted  some  authorities  (Lewis,  1987)  to 
advocate  the  use  of  the  electro-enoepha lograph  (EEG)  as  the  detector  of 
G-LOC.  During  unconsciousness,  the  EEG  changes  and  slower  rhythms 
appear.  It  is  proposed  that  a  detector  circuit  would  seek  these 
rhythms  and  then  take  over  control  under  G-LOC  to  provide  an  upward 
flight  path  vector  until  consciousness  was  regained.  It  remains  to  be 
seen  whether  the  reaction  times  of  this  device  together  with  the 
disadvantage  of  scalp  electrodes  makes  this  a  viable  strategy  for 
improved  flight  safety. 

ENVIRONMENTAL 

The  environmental  hazards  that  present  and  future  aircrews  will  be  exposed 
to  are  legion.  None  are  particularly  new  but  the  severity  and  combination  of  the 
types  of  hazard  increase  markedly  as  aircraft  performance  increases.  High  speed 
low  level  flight  is  often  accompanied  by  thermal  stress  as  the  sources  of  heat 
from  solar  glare,  cockpit  avionic s,  crew  metabolism  combine  with  that  of 
aerodynamic  heating  to  make  efficient  cockpit  conditioning  essential.  However, 
such  is  the  complexity  and  insulation  of  aircrew  clothing  needed  to  combat 
hypothermia  following  cold  weather  immersion  after  ejection  that  personal 
conditioning  rather  than  cockpit  conditioning  is  required.  Personal  conditioning 
can  be  effected  by  passing  a  cooling  medium,  either  air  or  liquid,  by  means  of  a 
special  garment  over  the  3kin  to  extract  heat  when  required.  These  systems  are 
particularly  useful  when  cockpit  conditioning  is  inefficient  for  example  on 
standby  on  the  ground,  taxying  or  in  very  hot  climates.  The  same  system  can  be 
used  to  warm  the  crew  under  cold  conditions.  Vapour  pressure  refrigeration  or 
thermoelectric  devices  can  be  used  as  heat  sinks  or  heat  sources. 


Thus  the  combination  of  cockpit  and  personal  conditioning  offers  the 
possibility  of  ensuring  thermal  equilibrium  of  the  crew  under  all  conditions  of 
flight  and,  with  separate  portable  supply  systems,  even  after  emergency  escape. 
Unfortunate ly  it  has  proved  difficult  to  add  these  systems  late  in  aircraft 
development  despite  their  comparative  simplicity.  Newer  efforts  are  required  to 
define  more  accurately  the  predicted  thermal  loading  in  flight  in  new  aircraft 
and  instal  systems  early  while  engineering  options  are  flexible. 

High  speed  low  level  flight  introduces  severe  vibration  spectra  as  the  more 
complex  aerodynamics  permit  faster  flight  closer  to  the  earth  surface  where 
detection  by  enemy  forces  is  more  difficult.  Higher  wing  loading  usually  permits 
the  avoidance  of  many  of  the  more  damaging  and  high  amplitude  vibrations  but  in 
turbulent  and  gusty  conditions  the  vibration  imposed  upon  the  aircrew  makes 
external  and  internal  cockpit  vision  difficult  and  induces  spurious  movements  to 
the  body  and  hands  which  increases  control  difficulties.  Although  the  criteria 
for  permissible  vibration  in  flight  have  been  accepted  for  some  time,  high 
performance  aircraft  and  their  crews  are  subjected  to  the  hazards  of  vibration 
and  there  seems  little  that  can  attenuate  it.  In  helicopters,  vibration 
attenuating  seats  have  been  used  (eg  Westland  Lynx)  but  the  attenuation  in  axes 
other  than  the  vertical  were  less  than  ideal  and  much  remains  to  be  done. 
Vibration  attenuation  in  ejection  seats  has  rarely  if  ever  been  attempted. 


Noise  in  aircraft  is  generated  by  power  plants,  gear  boxes,  propellers  or 
rotors,  aerodynamics ,  avionics  and  armaments.  Few  aircraft  exhibit  all  these 
types  but  high  speed  low  level  flight  in  fighter  aircraft  have  the  critical 
combination  of  severe  aerodynamic  and  engine  noise  coupled  with  particular  noise 
patterns  generated  by  engine  intakes  and  canopy  designs.  The  impulsive  noise 
from  guns  or  missiles  is  intensive  but  usually  brief.  Against  this  severe  noise 
background  aircrew  are  required  to  listen  and  communicate  with  a  multiplicity  of 
ground  and  air  stations,  to  interpret  audio  signals  from  missiles  and  radars, 
both  hostile  and  friendly,  and  to  listen  for  and  act  upon  audio  warnings  of 
varying  degrees  of  urgency  both  verbal  and  non  verbal,-  in  all  a  severe  conflict 
of  requirements.  Noise  exclusion  can  be  provided  by  improved  types  of  helmet  and 
ear  telephones  and  filtering  devices  can  be  incorporated  to  permit  only  the 
essential  audio  spectra  to  be  heard.  Active  noise  reduction  can  be  produced  by 
measuring  the  unwanted  noise  at  the  ear  by  a  small  microphone,  inverting  it 
electronically  and  reinserting  it  in  the  signal  to  the  ears  so  that  the  noise  and 
its  inversion  will  cancel  each  other,  so  leaving  the  incoming  signal  unimpaired. 
Laboratory  and  flight  tests  have  shown  that  this  system  to  be  feasible  and  it 
will  be  incorporated  in  many  new  aircraft.  Better  aerodynamic  design  may  also 
reduce  noise  in  flight  but  the  requirement  for  more  powerful  engines  and 
complicated  electronics  are  likely  to  negate  any  noise  reduction  from  improved 
intake  and  cockpit  canopy  designs. 

The  tactical  advantages  to  an  enemy  of  nuclear,  bacter iological  and  chemical 
(NBC)  weapons  is  undeniable.  However,  providing  aircraft  and  aircrews  can  be 
protected  from  these  hazards  and  allowed  to  complete  their  missions,  the 
advantages  of  these  weapons  to  an  enemy  is  severely  reduced.  Of  the  three,  the 
chemical  is  judged  to  provide  the  greatest  threat  to  aircrew  because  of  its  speed 
in  action  and  the  varied  methods  of  deployment.  Much  effort  has  been  expended  by 
all  NATO  forces  in  the  research  and  development  of  methods  to  protect  aircrew 
from  chemical  toxic  agents. 


All  methods  rely  on  absorption  of  the  agents  by  suitable  filters  and 
impenetrable  clothing  to  prevent  the  agents  reaching  the  skin,  conjunctivae  or 
respiratory  passages.  That  adequate  protection  can  be  provided  there  is  no  doubt 
but  the  physiological  load  that  such  protection  imposes  is  considerable.  Reduced 
immobility,  reduced  fields  of  vision,  slower  and  more  complex  donning  and  doffing 
procedures  and  heat  load  are  amongst  the  more  serious  effects  of  using  NBC 
defensive  ensembles.  Rest,  relaxation,  ablution  and  feeding  all  become  much  more 
difficult  when  wearing  NBC  apparel.  The  reduced  efficiency  in  flight,  caused  by 
NBC  clothing  is  difficult  to  quantify  but-  has  often  been  reported. 

Exercises  have  proved  that  aircrew  can  complete  their  mission  successfully 
with  effective  sortie  generation  and  repetition.  In  these  exercises  the 
complaints  of  aircrew  about  the  ensembles  usually  revolve  around  minor 
irritations  that  subsequent  modifications  have  removed  to  a  large  extent. 
However,  the  heat  load  remains  in  hot  climates  and  the  application  of  personal 
conditioning  by  closed  loop  liquid  systems  would  do  much  to  answer  the  complaints 
here.  Experiments  have  shown  that  the  NBC  ensembles  and  their  associated  drills 
become  more  acceptable  the  more  they  are  worn  and  performed.  Experience  should 
improve  the  confidence  of  aircrew  and  minimise  the  reported  reduction  of 
efficiency  in  flight. 


COCKPIT  INTERFACE 


The  role  of  the  aircrew  in  modern  high  speed  combat  aircraft  is  becoming 
more  of  a  manager  of  systems  than  pilots,  navigators  or  weapon  operators  in  the 
conventional  sense.  Modern  aircraft  have  computers  that  can  fly  the  aircraft, 
navigate  over  the  whole  sortie,  detect  and  acquire  targets  and  fire  weapons 
completely  automatically  if  required.  However,  if  it  were  as  simple  as  that 
there  would  be  no  need  for  aircrew.  In  truth,  the  most  space  efficient  computers 
of  all  are  the  aircrew  themselves. 

Although  much  of  the  management  process  can  be  delegated  to  automatic 
systems,  there  is  still  too  much  for  the  aircrew  to  do.  One  of  the  current 
problems  is  situational  awareness  where  the  aircrew  need  to  know  enough  to  hold  a 
true  model  of  reality  of  the  outside  world  to  ensure  the  efficiency  of  the 
flight.  On  occasions  they  may  become  overloaded  and  thus  cannot  prioritize  the 
inflow  of  data  so  that  important  messages  are  lost  and  awareness  of  the  true 
situation  suffers.  It.  is  not  only  what  data  are  required  but  when  and  in  what 
form.  Vital  information  which  requires  an  immediate  response  to  avoid  disaster 
must  take  precedence  over  all  but  there  are  many  other  information  sources  of 
lesser  importance  which,  if  neglected,  could  lead  to  loss  of  control,  loss  of  a 
way  point  or  misident i f icat ion  of  a  target.  The  mass  of  data  that  must  he  made 
available  to  the  aircrew  has  led  to  the  information  implosion  in  the  cockpit.  As 
an  example  of  the  multiplicity  of  data  streams  and  associated  controls  of  a 
current  high  performance  aircraft.,  the  F/A  18  Hornet  cathode  ray  tubes  display 


675  acronyms,  177  symbols,  7^  threat  and  danger  warnings,  40  multifunction 
display  formats  and  22  headup  display  configurations.  In  addition,  there  are  200 
film  strips  and  maps  on  the  horizontal  situation  indicator,  59  indicator  lights, 
6  auditory  warning  tones,  19  push  buttons  on  the  up-front  panel,  9  switches, 
mostly  multifunction,  on  the  throttle  and  7  switches  on  the  stick  (Taylor,  1986). 

The  Head  Up  Display  (HUD)  was  developed  as  a  means  of  permitting  the  pilot 
to  see  the  outside  world  while  still  viewing  the  instrument  display.  Of  its 
utility,  there  can  be  no  doubt,  however,  the  increase  in  the  amount  of  data  that 
can  be  displayed  on  it  leads  to  considerable  cluttering  such  that  many  modern 
HUDs  have  a  "declutter"  mode  where  only  essential  data  are  presented.  That  this 
particular  feature  is  necessary  is  seen  by  the  occasions,  in  simulators,  where 
attention  to  the  HUD  detail  has  diverted  attention  from  the  landing  runway  seen 
through  it  such  that  attempts  have  been  made  to  land  on  obstructed  runways 
(Fisher  et  al,  1980). 

Computerised  recognition  of  radar  emissions  and  electronic  counter  measures 
will  play  a  significant  role  in  any  future  combat .  This  is  because  many  of  the 
weapons  acquire  targets  by  radar.  The  various  types  of  weapon  have  differing 
electronic  signatures  and  evasion  from  the  weapon  will  require  recognition  of  the 
type  of  weapon  and  thus  its  capability.  Moreover,  one  will  need  to  know  whether 
that  weapon  is  in  flight  and  how  far  away.  This  recognition  will  be  computer 
assisted  but  recognition  of  an  audio  analogue  of  the  radar  may  well  he  the 
responsibility  of  the  crew.  As  many  of  the  weapons  that  are  likely  to  be 
deployed  in  war  may  be  unknown  to  the  opposing  forces,  recognition  is  likely  to 
be  an  all  or  nothing  case.  Furthermore,  the  computer  memory  may  well  be  deficient 
if  new  types  of  weapon  appear.  Thus  the  audio  channel  will  grow  in  importance  as 
a  data  source  and  high  audio  workloads  may  well  impair  audio  discrimination. 
Whilst  electronic  counter  measures  may  well  be  deployed  automa t ica 1 1 y  on  the 
receipt  of  certain  signals,  manual  control  is  likely  to  be  required  over  missiles 
and  their  signals  as  crews  will  be  reluctant  to  devolve  this  control  which  will 
have  such  a  marked  effect  upon  the  success  of  the  sortie. 

Visual  enhancement  devices  or  night  vision  goggles  ( NVG )  magnify  the  ambient 
light  to  levels  that  permit  operations  at  night  solely  by  visual  reference  to  the 
outside  world.  These  devices  have  reached  a  level  of  sophistication  that,  permits 
sorties  to  be  flown  almost  regardless  of  light  level  or  weather  conditions.  The 
devices  increase  capability  and  operational  flexibility  considerably  but  increase 
the  workload  on  the  crew  as  the  devices  are  limited  in  instanteous  field  of  view, 
they  lack  depth  appreciation  or  stereopsis  and  have  as  yet  no  colour 
discrimination.  Thus  other  clues  are  need  for  successful  mission  completion  or 
terrain  avoidance.  More  frequent  head  movements  and  cross  checking  with 
instrumentation  or  maps  are  activities  which  improve  confidence  but  the  limited 
field  of  view  at  high  turn  rates  can  limit  operations  in  hilly  terrain.  In  order 
to  prevent  NVG  saturation,  all  cockpit  lighting  can  be  screened  at  600nn  so  that 
a  blue  green  colour  reflection  of  the  instruments  is  seen  by  the  naked  eye  below 
the  goggle  but  the  reflected  light  is  too  short  in  wavelength  to  be  amplified  by 
the  goggle  itself. 

An  extension  of  the  technology  of  visual  enhancement  devices  is  to  display 
flight  and  other  data  on  the  aircrew  helmet  itself  utilising  the  reflective 
properties  of  the  protective  visor.  This  means  that  unlike  that  the  HUD  which 
only  projects  information  when  looking  along  or  near  the  aircraft  bore-sight 
axis,  whatever  the  direction  of  the  head  is  pointing  data  are  displayed  into  the 
eyes  of  the  crew.  These  displays  can  be  used  both  for  giving  information  to  the 
crew  and  to  the  aircraft  system  itself.  In  the  former  case,  warning,  engine  or 
flight  data  can  be  collimated  at  infinity  and  occluded  if  necessary  at  extreme 
head  angles. In  the  latter  case, the  display  can  act  as  a  weapon  sighting  device. 
For  this  the  head  and  eye  axis  is  measured  accurately  by  a  cockpit  sensor  system 
and  the  head  position  is  used  to  direct  missiles  or  guns.  The  operational 
advantages  of  the  device  tend  to  overload  the  visual  channel  of  the  crew  with  the 
added  problem  that  any  differential  movement  of  head  and  helmet  caused  by 
vibration  reduces  the  accuracy  of  the  system.  Moreover,  displays  on  helmets 
usually  mean  more  complex  and  heavier  helmets  which  have  to  be  borne  by  the 
crewman  magnified  many  times  under  acceleration.  No  one  has  yet  proposed  a 
counter  balanced  system  whereby  the  helmet  weight  is  carried  by  th*»  aircraft  or 
seat.  Although  this  is  an  obvious  solution,  the  problems  of  ensuring  freedom  for 
all  degrees  of  head  and  neck  movements  during  flight  and  the  precise  separation 
on  emergency  escape  are  difficult  to  overcome. 

We  are  all  aware  of  the  importance  that  colour  plays  in  visual 
discrimination.  Because  it  can  now  be  easily  simulated  in  electronic  displays, 
there  is  a  tendency  to  provide  colour  in  symbolic  displays  as  an  aid  to 
discrimination.  Unfortunately ,  the  colour  coding  is  unnatural  and  is  not 
intuitive.  Furthermore,  there  is  already  an  international  agreement  about  the 
use  of  three  to  five  colours  for  cautionary  and  emergency  warnings.  These 
colours  should  be  avoided  otherwise  confusion  arises.  The  skilful  use  of  colour 
in  all  types  of  displays  should  reduce  workload  but  unless  the  coding  is  simple 


to  understand  and  unambiguous,  it  becomes  another  variable  in  the  visual  channel 
which  is  already  well  overloaded.  Colours  can  be  used  to  group  data  and  when  no 
search  is  required,  tasks  can  be  simplified  by  colour.  Hue  is  useful  to  signify 
qualitative  differences  whilst  tone  can  present  quantitative  data  but  care  must 
be  used  less  the  hue  and  tone  differences  become  eroded  with  changes  in  cockpit 
1 1 1 uminat ion . 

The  ability  of  wave  form  and  signal  generators  to  create  a  wide  variety  of 
presentations  in  shape,  size  and  boundaries  can  be  used  to  present  simulations  of 
the  outside  world  when  the  external  view  is  denied  or  discrimination  too  poor  to 
be  reliable.  Fixed  symbols  are  a  1  ready  widely  used  but  the  ability  for  the 
electronic  symbol  to  change  shape,  size,  colour  and  position  as  data  dictate 
presents  an  almost  limitless  array  of  display  formats.  No  wonder  that  modern 
aircraft  cockpit  resembles  the  video  arcade  and  computer  games  already  in 
widespread  use.  Guidance  principles  for  computer  graphics  recommend  (Easterby, 
1970)  that  symbols  should  present  a  strong  boundary  with  high  contrast  against 
their  background,  the  form  or  shape  should  be  simple  in  outline  rather  than 
detailed,  the  shape  should  be  stable  and  unambiguous  and  symmetry  is  an  advantage 
in  recognition.  Where  symbols  are  grouped  or  classified  they  can  be  enclosed  in 
open  structures  for  ease  of  recognition.  Other  approaches  are  to  display 
pictures  in  action  such  as  branching  diagrams  which  can  be  used  for  various  menu 
selections  or  sequential  actions  as  in  check  lists  with  the  correct  procedure 
highlighted  or  accentuated.  In  this  manner  the  eye  is  guided  through  the  detail, 
the  correct  action  paging  sequential  displays.  These  concepts  follow  the  logical 
thinking  process  and  lead  the  pilot  through  the  displays  rather  than  requiring 
him  t.o  drive  it.  "Help"  sequences  in  computer  systems  have  a  similar  function. 

One  item  of  cockpit  equipment  that  can  be  more  simply  and  accurately 
replaced  by  computer  software  is  in  the  realm  of  cartography.  The  ability  to 
store  limitless  areas  of  maps,  over  many  scales,  with  relief  contouring  or  colour- 
coding,  bearing  tactical  notat ions , updates  or  alphanumeric  overprints  has 
enormous  advantages  over  the  older  methods  of  pre-prepared  hand  held  maps.  Land 
form  recognition  is  essential  for  navigation,  terrain  avoidance  and  survival  in 
hostilities  and  the  digital  presentation  of  the  land  mass  under  the  aircraft 
moved  by  the  inertial  navigator  in  accordance  with  the  aircraft  flight  path 
promotes  a  dramatic  improvement  in  operational  capability.  Topographical  data 
are  static  but  tactical  situations  are  dynamic  and  require  constant  refreshing. 
This  can  be  effected  either  pre-flight  or  in-flight  as  new  targets  are  located. 
They  can  be  marked  and  stored  in  the  digital  database  for  post-flight  debrief. 
Track  ball  or  skew  controls  can  be  used  to  move  symbols  and  co-ordinates  as  pen 
controls  or  t.o  interrogate  the  display  for  height  data.  Scroll  selections  can  be 
made  to  look  well  ahead  or  lateral ly  or  to  search  for  other  features  at  some 
distance  from  the  present  position.  North  or  t rack  orientation  is  selectable 
with  the  alphanumencs  and  overlays  always  appearing  the  right  way  up.  Finally, 
illumination  can  be  made  automat ica 1 ly  compatible  with  all  ambient  levels  and 
with  all  types  of  visual  enhancement,  device.  Digital  maps  can  thus  be  seen  .is  i 
major  advance  in  cockpit  design  that  diminishes  the  limitations  of  the  human 
operator . 

The  use  of  forward  looking  sensors  can  provide  vision  at  night,  in  cloud  and 
in  poor  visibility.  This  is  especially  useful  when  the  aircraft  must  remain 
passive  and  no  radar  emission  is  permitted.  Under  these  conditions  forward 
Looking  Infra  Red  <  FLIR  >  systems  combined  with  NVG  can  be  used  as  each 
complements  the  other.  FLIR  data  when  presented  head  up  in  raster  form  and  then 
visualised  in  turn  by  a  NVG  produces  a  greatly  enhanced  view  of  the  outside  world 
by  data  matching.  FLIR  detects  the  thermal  image  of  the  ground  in  monochrome  but 
is  obstructed  by  heavy  precipitation,  cloud  or  fog.  However,  particle  size  is 
important  and  FLIR  is  often  available  when  norma  1  vision  is  completely 
obstructed.  Any  temperature  or  absorption  difference  is  shown  in  FLIR,  cold 
areas  where  shadows  have  been  can  show  the  previous  local  ions  of  parked  aircraft, 
colder  patches  on  aircraft  wings  can  reveal  newly  filled  fuel  tanks.  NVG  in 
contrast  only  use  reflected  ambient  light  and  highly  illuminated  areas  appear  as 
bright  spots  on  the  display.  The  NVG  mounted  on  the  head  represents  all  round 
vision  with  head  movement  whilst  the  FLIR  data  is  concentrated  in  the  narrow  head 
up  display.  The  integration  of  these  two  separate  sensor  devices  produces  the 
capability  to  operate  in  conditions  never  possible  before. 

The  visual  channel  is  well  utilised  in  all  modern  aircraft  and  over  used  in 
many.  As  workloads  have  increased,  the  voice  channel  has  been  developed  both  as 
means  of  receiving  data  and  also  a  means  of  control.  Audio  systems  are  by  no 
means  new  features  in  aircraft.  Bells,  buzzers,  warnings  and  chimes  are  all  in 
regular  use  and  analogue  tone  changes  have  been  used  as  speed  warnings  on  Naval 
aircraft  where  it  proved  difficult  to  display  analogue  air  speed  data  head  up. 
New  systems  use  both  verbal  and  n«m  verbal  warnings  and  the  spoken  "pul  1-up" 
demands  in  ground  proximity  warning  systems  have  already  established  their  worth. 
However,  the  newer  applications  are  in  the  areas  of  verbal  rout iol  of  aircraft 
systems  where  no  other  control  channels  remain  available.  Experiments  have 
shown  that  with  even  fairly  ineffective  microphones  in  noisy  masks,  systems  can 


recognise  accurately  up  to  92^>  of  a  50  word  vocatulary  u?  j  nq  unskilled  operators 
< Poston , 1 9fl6 ) .  Moreover,  when  comparing  voice  data  entry  to  that  by  keyboard, 
responses  to  cues  for  data  entry  were  faster  by  voice.  Errors  were  made  more 
frequently  with  voice  but  this  was  due  to  the  greater  number  of  data  bits 
required  by  voice  than  by  keyboard  but.  subjective  preference  was  overwhelmingly 
for  the  voice  channel.  Furthermore,  this  experiment  permitted  easy  keyboard  use. 
Where  there  is  no  possibility  of  fast  keyboard  entry,  v«»i«*e  entry  comes  into  its 
own  even  under  conditions  of  severe  vibration. 

To  offload  the  aircrew  during  a  difficult  and  complex  mission, a  sysf  <*n  is 
required  to  manage  all  those  aspects  of  the  mission  which  do  rt<>t  require  t  he 
crews*  direct  intervention.  Most  systems  have  built  in  aul<»nat  m>n  where 
microprocessor  control  regulates  much  <>f  the  technology  already  and  •  he  crew  .ire- 
only  warned  where  urgent  rectification  is  required.  However,  it  '-.«n  be  argued 
that  if  the  crew  can  rectify  the  problem  so  could  the  system  thus  bypassing  the 
crew.  Only  when  operational  capability  is  seriously  threatened  should  t he  crew 
be  involved.  Now  that  philosophy  can  be  extended  to  other  areas  of  the 
aircraft,  particularly  the  weapon  system.  The  aim  is  \  ■>  produce  a  pilots* 
automatic  assistant,  a  software  package  to  aid  the  pilots  through  attack  mission 
by  managing  displays,  tasks  and  performing  much  of  the  attack  itself.  One  system 
under  development  for  the  I’S  Navy  (McEl roy , 1986 >  uses  a  radar  module  which 
recognises  radar  profiles  by  reference  to  a  built  in  library  and  highlights  the 
recognition  and  class l f icat ion  features  of  the  individual  profile.  Filtration 
and  averaging  techniques  over  many  images  further  refines  the  data  and  a  smooth 
profile  is  identified  and  presented  for  pilot  acceptance.  Another  nodule  uses 
video  data  t.o  track  and  counter  hostile  surface  to  air  missiles  (SAMst.  The 
system  analyses  the  radar  signal  and  selects  the  appropriate  counter  measure.  M 
tracks  the  SAM,  confirms  its  type  and  capability  and,  when  opportune,  requests 
the  pilot  to  authorise  the  counter  measures.  A  third  module  manages  the  «  row 
interface.  It  senses  and  analyses  a  1  1  data  either  arriving,  leaving  or  generated 
within  the  aircraft.  rt  tracks  the  aircraft  position  and  the  positions  of  all 
other  aircraft  and  ships,  hostile  or  friendly.  It  examines  probable  arid  possible 
moves  and  counter  moves  of  other  aircraft  and  ships  and  presents  so lut  ions  to  t h* 
pilot  updating  his  situational  awareness.  tt  priunt  i/en  the  thr«-.,tw  an  I 
automat  ica  1  l  y  moves  on  to  other  tasks.  Only  when  the  system  demands  ,(i- 
author i sat  ion  from  the  crew  are  they  addressed.  Thus  t he  crew  become  aware  of 
the  situation  only  when  they  need  to  and  in  t  me  so  they  can  react  t..  it  ,  Only 
when  the  system  fails  is  manual  control  aga  i  n  required.  Further  refinement x  t<< 
this  concept  surround  the  ability  of  the  system  to  learn  as  it  acts,  fine  tuning 
the  decisions  it  takes,  requiring  less  and  less  intervention  from  the  crew.  It 
is  expected  that  much  will  be  achieved  i  ri  tins  important  area  as  it  offers  the 
greatest  relief  to  the  crew  in  the  mission  enabling  then  f<*  maintain  maximal 
visual  search  and  aircraft  control  at  extreme  speeds  low  level,  the  only  flight 
regime  in  hostile  areas  where  survival  is  likely. 
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SUMMARY 


The  physiologic  requirements  tc  validate  a  +G„  tolerance  model  based  on  arterial 
pressure  (Pa),  eye-heart  vertical  distance  (h) ,  and  Hydrostatic  pressures  (P^)  are  inves¬ 
tigated.  Venous  return  (VR)  and  intrathoracic  pressures  (Pj)  are  considered  the  major 
physiologic  parameters  involved  in  supporting  this  model  at  levels  above  9  G. 

Venous  return  was  determined  to  be  adequate  to  support  Pa  during  either  relaxed 
lower-level  G  tolerance  or  high  sustained  G.  Some  concern  exists  regarding  VR  during  long 
duration  G  exposures,  because  of  the  delayed  compliant  nature  of  veins. 

Pj,  the  physiologic  basis  for  the  anti-G  straining  maneuver  (AGSM) ,  was  found  to 
be  a  function  of  inspiratory  volume  (Vj) ;  and,  therefore,  as  the  subject  is  reclined 
(+Gj.)  to  reduce  h,  the  reduction  in  Vj  prevents  a  maximum  AGSM  limiting  tolerance  to 
15  G.  On  the  other  hand,  pilot  pronation  (-Gx)  may  not  limit  Vj ,  and  higher  G  tolerance 
may  be  possible.  Neithei  physiologic  function,  PT  or  VR,  appears  to  limit  G  tolerances  up 
to  15  G. 

Fatigue  was  recognized  as  an  important  dimension  of  G  tolerance  and,  as  such, 
was  examined  as  a  limiting  physiologic  function  at  high  sustained  G.  Primarily,  because 
of  the  functional  coupling  between  G-level  and  G-duration  tolerances,  if  one  is  not  G- 
tolerance  limiting,  neither  is  the  other. 


INTRODUCTION 

Recently,  we  developed  a  model  for  predicting  pilot  G  tolerances  that  considered 
all  proven  methods  for  increasing  G  tolerance  (1) .  This  model  included  various  seat  back 
angles,  as  large  as  75®  (from  the  vertical),  that  are  considered  practical  for  piloting 
aircraft.  Although  this  model  was  developed  to  interrelate  various  methods  of  G  protec¬ 
tion  so  that  a  mean  G  tolerance  could  be  calculated  up  to  9  G,  G  tolerances  of  20  3  are 
predicted — a  level  that  far  exceeds  the  9  G  of  today's  fighter  aircraft  (Fig.  i) .  Yet, 
today,  we  frequently  hear  that  the  pilot  is  the  limiting  factor  in  maneuverability  (the 
development  of  G  forces)  in  today's  high  performance  aircraft. 


Figure  1.  G  tolerances  are  shown  using  known  methods  of  G 
protection  for  a  group  of  pilots  (1). 


The  pilot  has  always,  to  some  extent,  been  considered  the  limiting  factor.  G- 
induced  loss  of  consc iousness  (G-LOC)  frequently  occurred  in  pilots  flying  "high  perform¬ 
ance"  aircraft  in  World  War  I  (WWI) .  Snoopy  and  the  Red  Baron  were  the  limiting  factors 
in  such  advanced  aircraft  as  the  Sopwith  Camel  and  Triplane,  and  the  De  Havilland  4  (2). 
Yet,  today's  pilot  easily  tolerates  higher  G  levels  than  those  hat  occurred  in  WWI,  not 
because  the  pilot's  G  tolerance  evolved  with  advances  in  fighter  aircraft  technology,  but 
because  of  the  evolution  of  the  pilot's  life  support  equipment.  Therefore,  when  we  state 
that  today's  aircraft  and  those  on  the  drawing  boards  are  "pilot  limited,"  we  really  mean 
that  these  aircraft  are  "anti-G  equipment  limited."  This  assumption,  however,  is  valid 
today  if  we  are  only  aware  of  life  support  equipment  that  has  been  developed,  tested,  and 
is  ready  for  operations.  If  suitable  equipment  is  potentially  available  and  as  effective 
as  the  model  suggests,  why,  then,  is  the  pilot  considered  the  limiting  factor? 


This  seemingly  paradoxical  situation  requires  that  three  questions  be  answered-- 
the  last  of  which  will  be  the  topic  for  this  article:  (a)  Is  the  pilot  necessary  in 
future  fighter  aircraft,  or  has  the  time  for  pilotless  (robotics)  aircraft  arrived? 

(b)  If  adequate  anti-G  methods  are  known  and  available,  why  are  they  not  operational? 

(c)  Is  our  model  really  G-tolerance  predictive  above  9  G? 

The  first  two  questions  have  been  considered  recently,  in  Aviation,  Space ,  and 
Environmental  Medicine,  in  a  Guest  Editorial  entitled,  "A  Perspective  on  Human  Perfor¬ 
mance  As  the  Limiting  Factor  in  Aircraft  Performance"  (3) .  In  this  article,  the  author 
concluded:  (a)  that  the  pilot  was  not  the  "limiting  factor,"  but  the  "enabling  factor"  in 
current  and  future  fighter  aircraft,  thus  clearly  relegating  the  robot  to  a  role  in  the 
more  distant  future?  and  (b)  that,  in  regard  to  G  protection  which  is  available  but 
operational  —  the  limiting  human  is  not  the  pilot  in  the  air,  but  "can  be  found  in  a  num¬ 
ber  of  places  on  the  ground." 

The  final  question,  therefore,  invokes  the  validity  of  our  model  in  predicting  G 
tolerances  above  9  G  for  pilots  using  various  anti-G  methods,  in  combination  or  sepa¬ 
rately.  Using  known  technologies,  this  model  predicts  that  pilots  could  conceivably  tol¬ 
erate  20  G.  Of  course,  as  data  are  extrapolated  in  the  development  of  predictive  models, 
variables  that  cannot  be  necessarily  identified  nor  predicted  may  cause  these  "far  reach¬ 
ing"  extrapolations  to  become  meaningless. 

That  the  human  can  function  at  a  20-G  level  is  not  inconceivable.  Humans  have  been 
exposed  to  +15  Gx  without  serious  physiologic  consequences.  The  limiting  factor  was 
apparently  the  inability  of  the  subject  to  breathe,  because  of  the  work  required  to 
expand  the  lung  against  the  applied  +GX  forces  (4-6). 

But,  if  an  individual  is  not  completely  reclined  (thereby  possibly  reducing  the 
consequences  of  this  problem),  and  if  he  uses  such  available  anti-G  methods  as  assisted 
positive  pressure  breathing  (PPB) ,  what  are  the  physiologic  limitations  that  can  now  be 
accurately  predicted?  If  none  exist,  as  determined  by  use  of  the  physiologic  data  we  now 
possess,  then  maybe  a  pilot  using  assisted  PPB  can  tolerate  20  G  in  a  75°  reclined  or 
pronated  seat.  In  this  article,  therefore,  we  shall  explore  possible  limitations?  and  we 
shall  consider  some  physiologic  functions  that  must  prevail  if  this  model  is  to  have  any 
significant  predictive  value.  To  this  end,  we  will  examine  the  physiologic  bases  that 
make  this  model  predictive,  using  appropriate  research  that  supports  the  validity  of  this 
model's  predictability. 

In  addition,  we  shall  consider  the  other  dimension  of  G  tolerance:  fatigue.  Over 
the  last  decade,  this  measure  of  G  tolerance  has  grown  in  significance  until  it  is  now 
considered  as  important  in  pilot  protection  as  G-level  tolerance. 


PHYSIOLOGIC  BASIS  OF  THE  MODEL 

The  development  of  this  model  was  completely  mathematical,  based  on  simple  hydro¬ 
static  pressure  principles.  If  this  model  is  to  be  predictive  for  high  G  tolerances,  how¬ 
ever,  some  basic  physiologic  concepts  must  be  considered. 

Venous  Return: 


A  major  physiologic  premise  regarding  this  model,  as  it  predicts  "relaxed"  G- 
tolerances,  is  that  adequate  venous  return  is  available  to  support  the  arterial  pressure 
at  head  level  during  increased  +GZ.  Our  model  is  based  on  Pa,  generated  by  the  heart, 
that  in  opposed  by  hydrostatic  pressures  that  develop  within  the  body  during  exposures  to 
+GZ  forces.  These  hydrostatic  pressures,  caused  by  an  increase  in  G,  can  be  calculated: 

PH  =  hdg . (1) 

where : 

PH  =  hydrostatic  pressure  in  mmHg 
h  =  height  of  a  fluid  column 

d  =  specific  density  of  the  fluid  relative  to  that  of  Hg 
g  =  ambient  accelerative  inertial  force  (G) 

Using  Eq.(l)  with  a  column  height  of  330  mm  (eye-heart  vertical  distance  in  an  average 
erect  human),  and  a  fluid  specific  density  for  blood  relative  to  Hg  (13.6)  =  1/13.6,  the 
effect  of  any  G  level  on  PH  at  heart  level  as  measured  in  millimeters  of  mercury  can  be 
calculated.  In  the  erect  human  body,  this  pressure  is  opposed  by  a  mrtan  Pa  of  approxi¬ 
mately  100  mmHg.  As  Pm  increases  and  Pa-PH  approaches  intraocular  pressure  of  15-20  mmHg 
at  eye  level,  arterial  blood  flow  to  the  retina  ceases,  and  G  tolerance  is  established, 
in  which  case: 

Pa  =  PH  or  Pa  =  hdg,  or 


G 


Pa  *  d/h 


(2) 


where: 


6-3 


G  =  G  tolerance  (blackout) 

Pa  =  arterial  pressure  generated  by  the  heart 
(98.4  mmHg ) 1 

d  =  13.6 

h  =  330  mm. 

This  equation,  if  predicting  relaxed  G  tolerances  in  humans,  assumes  the  very 
important  fact  that  there  is  sufficient  venous  return,  so  that  the  heart  has  the  required 
blood  volume  to  maintain  adequate  cardiac  output. 

Three  studies  have  measured  relaxed  rapid  onset  rate  (ROR)  +GZ  tolerance  and  the 
eye-heart  vertical  distance  (7-9).  The  results  of  these  studies  are  compared  using  Eq.{2) 
and,  in  Fig.  2,  showing  the  existence  of  a  very  close  correlation.  We  can  assume,  there¬ 
fore,  that  venous  return  is  adequate  to  support  cardiac  output,  and  with  vasoconstriction 
(sympathetic  responses)  maintains  Pa  at  a  level  that  opposes  as  calculated  using 
Eq. (2)  . 

Eye-level  direct  Pa  has  been  measured  during  peripheral  light  loss  (PLL)  in  humans 
at  the  onset  of  G,  both  with  and  without  an  anti-G  suit  (10)  .  As  expected,  and  as  shown 
in  Fig.  3,  Pa  decreases  with  the  increase  in  +G~  to  a  level  at  which  PLL  should  occur; 
but  apparently,  because  of  energy  reserves  in  the  retina  and  brain,  vision  is  not  lost 
and  some  Pa  recovery  occurs.  This  latent  period,  during  which  light  loss  and  loss  of  con¬ 
sciousness  will  not  occur,  is  about  5  s,  and  has  been  measured  by  Beckman  et  al.  (11) 
and,  more  recently,  in  our  laboratory.  At  about  5  s,  a  rebound  in  Pa  occurs.  However, 
this  increase  in  Pa  does  not  continue.  In  fact,  a  decrease  follows,  resulting  in  PLL;  and 
the  G  tolerance  is  established. 


c 


Figure  2.  G  tolerances  of  relaxed  subjects  Figure  3.  Eye-level  Pa  responses  of  humans 

wearing  an  uninflated  anti-G  suit,  to  increased  +GZ  exposures 

as  determined  using  Eq.(2)  of  text.  resulting  in  peripheral  light 

Data  represented  by:  open  circles  loss  (10). 

(O),  (mean  ±  S.E.M.)  are  from 
Burns  and  Whinnery  (7);  open 
squares  (□),  from  Burns  (8);  and 
closed  circles  {#),  from  Crossley 
and  Glaister  (9)  . 


It  is  important  to  realize,  therefore,  that  a  dynamic  cardiovascular  system  is 
functioning  during  this  initial  exposure  to  +GZ;  and  although  the  hydrostatic  pressures 
do  affect  Pa  considerably,  both  higher  and  lower  Pa  occur  before  the  "tolerance"  Pa 
develops,  thus  causing  PLL.  This  temporary  rebound  phenomenon  does  indicate  an  increase 
in  cardiac  output,  possibly  caused  by  a  mobilization  of  blood  reserves  from  the  lungs 
(12) .  Nonetheless,  venous  return  is  proceeding  at  a  level  to  support  Pa  until  the  occur¬ 
rence  of  a  G-tolerance  criterion  at  a  G-level  significantly  affected  by  P^ . 

This  P„  effect  on  G  tolerance  is  even  significant  on  an  individual  subject  basis, 
and  has  been  determined  to  have  an  inverse,  significant  correlation  with  relaxed  G  toler¬ 
ance  of  r=-0.41,  with  systolic  arterial  pressure  (Pa)  having  an  additional  correlation  of 
r=+0.4B.  Their  combination  for  individuals  has  a  multiple  correlation  of  r=0.70  (13).  On 
a  group  basis,  with  individual  variabilities  statistically  removed,  a  higher  PH  effect  is 
anticipated,  and  shown  to  exist  (Fig.  2).  The  physiologic  basis,  in  support  of  venous- 
return  during  reductions  in  Pa,  is  venoconstric tion  of  the  large  veils  in  the  legs  and 
splanchnic  region  via  the  carotid  sinus  baroceptor  reflex,  and  the  distensibil ity  charac¬ 
teristics  of  these  veins  (14-18).  This  particular  venomotor  reflex  has  been  examined  in 
dogs  during  exposure  to  increases  in  +GZ,  and  the  response  of  this  reflex  has  been  shown 
to  be  directly  correlated  with  the  percent  ^eduction  in  Pa  at  onset  of  G  (19) .  The  major 
veins  of  the  body,  during  short  duration  *  osures  to  increased  venous  pressure  (because 

1This  value  for  Pa  is  calculated  from  data  from  Burns  and  Whinnery  (7) --refer  to 
Burton  (1)  for  details  about  its  derivation. 


of  increased  G) ,  tend  to  be  non-compl iant  and  resist  blood  pooling,  thereby  supporting 
venous  return  during  the  onset  of  G.  On  the  other  hand,  extended  duration  of  increased 
venous  pressure  {discussed  later  in  this  article)  causes  reduced  blood  flow  because  of 
"delayed  compliance"  (14). 

Therefore,  because  of  several  physiologic  functions  that  support  venous  return, 
adequate  Pa  appears  to  prevail,  at  least  during  lower  levels  of  +GZ  exposure,  to  support 
this  Pa-based  model. 

Venous  return  at  high  G  levels,  when  the  AGSM  is  used  by  pilots  to  increase  their 
G  tolerance  (Fig.  2) ,  has  only  been  studied  in  miniature  swine  (20) .  The  increase  in  the 
intrathoracic  pressure  (Pj) ,  during  the  forced  exhalation  portion  of  the  AGSM,  would 
impede  venous  return — but  to  what  extent  is  unknown. 

Venous  flow  (VF)  in  the  inferior  vena  cava  at  the  level  of  the  diaphragm  was  mea¬ 
sured  at  +3,  5,  and  7  Gz  for  60  s  in  swine,  with  and  without  a  pressurized  anti-G  suit 
(20) .  Astonishingly,  venous  flow  was  maintained  at  5  and  7  G,  even  during  the  straining 
part  of  AGSM  in  pigs,  and  even  without  the  anti-G  suit;  but  VF  was  much  greater  during 
the  no  strain  portion  of  the  AGSM,  especially  in  pigs  wearing  the  anti-G  suit  (Table  1). 
As  VR  declines  and  can  no  longer  adequately  support  heart  function,  heart  rate  slows  with 
dramatic  bradycardia,  and  loss  of  consciousness  occurs.  The  importance  of  the  anti-G  suit 
in  VR  is  clearly  demonstrated  in  this  study,  particularly  during  sustained  G  exposures. 

Venous  return,  therefore,  can  be  maintained  (not  surprisingly)  at  high  G  levels 
where  the  AGSM  is  required?  and  an  indicator  of  adequate  VR  is  heart  rate.  Venous  return 
does  not  appear  to  be  a  limiting  physiologic  function  at  high  G. 
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Data  are  means  s  SSK.  W.'OS,  witr.cut  G-su;t;  K£,  with  G-suit;  C,  ccr.ticl  ceiur*  *C,;  G ,  rear,  iota  ever  i:  7 
*0.  exfes ure;  F,  mean  cara  coring  strair. ir.y  maneuver;  ::r,  rear,  data  curing  nc-stro.r.  ;  :  rat  . 

Intrathoracic  Pressure  in  Support  of  Pa: 

Our  original  model  bases  4  G  of  protection  at  9  G  on  the  Pj-  generated  by  the  AGSM. 
We  assumed  that  Pa  was  increased  by  100  mmHg  with  a  Pj  of  100  mmHg  for  a  group  of  indi¬ 
viduals  who  represented  a  maximum  AGSM  effort  (Fig.  1).  That  is,  we  assumed  for  model 
simplicity,  that  the  relationship  of  the  in tra thorac ic  pressure  ( Pj ) — that  increases  dur¬ 
ing  the  AGSM  and  is  the  basis  for  increasing  Pa — to  Pa  was  1:1,  even  though  we  were 
aware,  because  of  prior  animal  and  human  studies,  that  the  PjjPa  ratio  was  more  realisti¬ 
cally  0.8  (20,21).  This  comrromise  did  not  significantly  affect  our  original  model,  since 
we  were  concerned  with  "lower"  G  levels  of  *9  G.  However:#  as  we  extrapolate  our  model 
above  9  G  where  the  AGSM  becomes  the  major  modality  of  G  protection,  possibly  allowing  a 
subject  to  tolerate  20  G,  a  more  accurate  PjiPa  ratio  will  be  incorporated  into  the 
model.  That  is  to  say,  as  the  eye-heart  vertical  distance  (h  of  Eq . ( 3 ) )  becomes  smaller 
(as  the  subject  is  reclined  or  pronated) ,  G  tolerance  increases  exponentially  with  an 
increase  in  Pa;  i.e.,  4  G  protection  results  from  an  increase  in  Pa  of  100  mmHg  in  the 
upright  subject,  whereas  reclining  that  subject  to  75®  results  in  eye-heart  vertical  dis¬ 
tance  of  150  mir.  implying  that  the  same  100  mmHg  of  Pa  produces  an  increase  in  G  tolerance 
of  9  G.  However,  the  physiologic  effect  of  Pj  on  G  tolerance  remains  as  a  simple  summa¬ 
tion  with  Pa,  so  that: 

G  =  (Pa  +  0.8  Pj )  •  d/h . (3' 


Pj  =  Intrathoracic*  pressure  ir.  mmHg 
G,  Pa,  d,  and  r.  are  the  same  as  Eq.(2). 

Therefore,  the  following  physiologic  question  arises  regarding  the  model's  G-tolerance 
yrcdictabii  i  ty:  Is  it  possible  fer  a  subject  to  continue  to  increase  the  Pa  with  the  sup¬ 
port  of  P-r  at  these  high  G  levels? 

Two  variables  must  be  considered  regarding  the  ability  of  a  subject  to  increase 
the  Pj,  with  a  voluntary  effort,  in  this  environment:  (a)  the  ability  to  develop  an 
inspiratory  volume  at  these  high  G  levels?  and  (b)  the  effect  of  change  in  posture  (supi¬ 
nation  or  pronation)  on  developing  an  increased  Pj. 

First,  however,  does  Fj  at  the  levels  required  to  develop  an  increase  in  Pa  of 
approximately  100  mmHg  occur  in  humans  using  the  AGSM?  In  our  original  model  validation, 
adequate  Ft,  as  measured  with  esophageal  pressures  (PeS),  did  appear  to  be  generated  by 


subjects  during  exposures  to  increased  G  at  different  seat-back  angles  to  produce  the 
required  Pa  (Table  2).  However,  data  showing  the  maximum  Pj,  that  can  be  developed  by 
human  subjects,  were  not  available. 


6-5 


TABLE  2.  ESOPHAGEAL  PRESSURES  (P  )  IN  mmHg  IN 
GROUPS  OF  SUBJECTS  (N)  AS  RELATED  TO 


SEAT 

BACK  ANGLES 

AND  h  (1) 

Seat 

L. 

h 

(mm) 

(mmHg) 

Na 

13® 

334 

52.9 

3 

30® 

334 

44.8 

2 

45® 

280 

40.7 

3 

55® 

250 

29.2 

2 

65® 

220 

15.3 

3 

75® 

175 

16.7 

2 

45® 

280 

76.5 

2 

65® 

220 

27.8 

2 

aNumber  of  subjects  per  croup. 


Recently,  maximum  Pj  was  determined  in  subjects  in  various  postures  at  1  G  per¬ 
forming  an  AGSM.  Their  spine-to-*-hiyn  angles  ranged  from  70°  to  105®  (four  different 
angles) ,  with  a  maximum  Pj  effort  by  each  subject  at  each  angle.  Angle  did  not  affect  the 
results  that  showed  the  maximum  Pj  for  a  group  of  subjects  to  be  approximately  110  mmHg 
for  the  initial  strain  (Fig.  4).  These  maximum  Pj  efforts  resulted  in  increases  in  Pa  of 
about  80  mmHg,  once  again  showing  that  the  Pa:Pj  ratio  is  approximately  0.8  (Fic.  5' . 
Successive  efforts  were  less  effective,  indicating  that  subject  fatigue  was  pianino  a 
role  in  their  AGSM  ability.  The  probable  role  of  fatigue  on  this  model  is  discussed 
briefly  later. 
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Fiyuit-  4.  Maximum  Pj  developed  by  subjects  at 
1  G  performing  an  AGSM  (22) .  All 
subjects  wore  an  uninflated  anti-G 
suit.  Three  AGSM  efforts  were  per¬ 
formed  during  the  15-s  time  period. 


Figure  5.  Effect  of  a  maximum  Pj  (see 

Fig.  4)  on  Pa  in  subjects  per¬ 
forming  the  AGSM  at  1  G  (22) . 


Extrapolating  G  tolerance  predictions  above  9  G,  using  our  model,  has  never  been 
previously  attempted.  At  these  high  levels  of  G,  very  little  interest  appears  to  have 
prevailed  regarding  human  G  tolerance  studies.  According  to  a  review  of  the  literature. 


Only  one  study  has  been  conducted  to  determine  the  maximum  G  level  tolerance  possible  in 
a  reclined  seat  configuration  (supine  +GX)  using  the  AGSM,  and  no  studies  have  been  con¬ 
ducted  using  pronation  {-Gx) .  Wood  (23)  aid  report  on  a  study,  conducted  in  1945  on  the 
human-use  centrifuge  at  the  University  of  Southern  California,  that  had  8  subjects  expe¬ 
riencing  -12  Gx  without  any  visual  symptoms.  The  maximum  -Gx  tolerance  of  these  subjects 
was  apparently  never  attempted. 

Unfortunately,  the  one  +GX  study  which  used  a  75®  seat,  also  used  inexperienced 
subjects,  as  well  as  the  pelvis-and-legs  elevating  (PALE)  seat  that  does  not  reduce  the 
eye-heart  vertical  distance  substantially  (6).  Consequently,  these  subjects  achieved  only 
a  mean  G  tolerance  of  8.4  G  using  the  PALE  seat,  anti-G  suit,  and  AGSM.  This  level  of  G 
tolerance  is  easily  obtained  in  the  upright  seat,  using  well  trained  subjects  wearing  the 
anti-G  suit  and  performing  the  AGSM  (24)  .  In  that  PALE-seat  study,  however,  the  authors 
noted  that  one  subject  tolerated  +14  Gx  for  45  s  without  any  peripheral  light  loss  or 
"any  other  undesirable  symptoms."  It  is  worth  noting,  moreover,  that,  at  a  75®  back  angle 
with  the  head  extended  along  the  back  angle,  10  G  is  obtained  in  relaxed  individuals  as 
predicted  by  the  model  (25) . 

In  considering,  therefore,  the  ability  of  a  subject  to  perform  the  AGSM  in  a  high 
G  environment  (>9  G) ,  various  protective  methods  must  be  evaluated,  as  well  as  how  these 
relate  to  increased  seat  back  angles  that  reduce  "h"  of  Eq.(2). 

The  relationship  between  the  inspiratory  volume  ( V-j- )  on  Pj,  as  gei.ei.atcd  by  +hr- 
AGSM,  has  been  developed  and  has  shown  that,  for  peak  pressures  above  80  mmHg  up  to  a 
maximum  of  108  mmHg,  more  than  10%  of  the  maximum  inspiratory  volume  is  required  (26) . 
However,  it  is  interesting  that  significant  levels  (80%)  of  Pj  can  be  obtained  using  only 
12.5%  of  the  maximum  inspiratory  capacity  of  the  subject  (Fig.  6). 

Lung  volumes  are  affected  differently  by  supination  or  pronation.  The  former, 
because  of  the  increased  weight  on  tlie  chest,  causes  large  reductions  in  most  lung  vol¬ 
umes  so  that,  at  +8  Gx,  the  inspiratory  reserve  (IR)  is  about  25%  of  the  inspiratory  vol¬ 
ume  found  at  1  G  (27).  This  relationship  between  level  of  +GX  and  IR  volume  is  shown  in 
Pig.  7.  This  sigmoidal  function  suggests  that  the  reduction  in  IR,  although  progressing 
at  higher  G  levels,  is  doing  so  less  rapidly  than  at  the  mid-G  level  range  of  4-6  +GX,  so 
that  an  IR  of  12.5%  is  reasonable  for  high  G  levels  of  *15  G. 
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Figure  7.  Relationship  of  inspiratory 
reserve  with  78°  back  angle. 
Developed  from  data  from  Watson 
and  Cberniach  (27 ) . 


Cote  et  al.  (261,  in  their  study,  found  that  at  an  IR  of  12.5%  the  maximum  P-  was 
80  mmHg;  so,  by  using  the  same  Pj  in  Eq.(3),  a  tolerance  of  14.8  G  is  predicted.  This  G 
level  is  the  maximum  that  has  been  demonstrated  on  a  centrifuge  that  a  human  can  tolerate 
in  the  +GX  vector  (4-6).  Therefore,  as  a  person  is  supinated,  the  reduction  in  the  IK 
significantly  limits  the  level  of  AGSM  that  is  possible.  We  may  conclude  that,  even 
though  a  given  increase  in  Pa  at  greater  seat  back  angles  results  in  proportionately 
greater  increases  in  G  tolerance  (Fig.  1),  because  of  thi.-  limited  ability  to  do  an  AGSM, 
tlie  increase  in  G  tolerance  provided  by  the  AGSM  at  75®  seat  back  angle  remains  at  about 
4  G. 

Unassisted  PPB,  at  moderate  levels  of  2-3  mmHg  per  G  up  to  2D  mmHg  at  8  G,  signif¬ 
icantly  reduced  the  decrease  in  IR  found  at  +8  Gx .  Therefore,  instead  o£  only  26%  of  1  C 
values,  IR  was  41%,  yielding  an  increase  in  projected  P.  of  12  mmHg.  With  an  h  of  15C  mm, 
this  would  result  in  an  expected  tolerance  increase  of  1  G  (Eq.(3)) .  Greater  benefits 
might  be  possible  with  increased  levels  of  PPB,  including  the  use  of  chest  counters rcs- 
sure  (assisted  PPB) .  Recent  studies  with  subjects  positioned  upright  experiencing  +GZ 
have  snown  tolerances  up  to  70  mmHg  of  assisted  PPB,  although  50  mmHg  was  considered ‘"'the 
most  beneficial  (28).  Fifty  mmHg  of  assisted  PPB  is  expected  to  increase  +GZ  tolerance  by 
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Figure  6.  Maximum  PT  generated  by  percent  of 
Vj  (26)  . 


approximately  2  G  (Eq.(3);  Fig.  1).  Recently,  test  flights  in  both  the  F-15  and  F-16  at 
the  Air  Force  Flight  Test  Center  (AFFTC) ,  Edwards  AFB,  have  demonstrated  that  this  level 
of  assisted  PPB  increases  +GZ  tolerance  (as  subjectively  evaluated  by  pilots)  by  2  G. 

Pronation  does  eliminate  these  large  reductions  in  lung  volumes  as  h  is  reduced 
(29).  The  maintenance  of  a  large  inspiratory  reserve,  therefore,  would  allow  the  subject 
to  perform  an  effective  AGSM,  thus  suggesting  that  extremely  high  G  tolerances  (such  as 
predicted  in  Fig.  1)  could  be  obtained  with  an  h  of  150  mm.  A  shorter  h,  relative  to  seat 
back  angle,  is  possible  as  a  human  is  pronated  (as  opposed  to  supination)  because  of  the 
eye-heart  vertical  relationship  (Fig.  8).  During  the  beginning  of  reclining,  h  actually 
increases,  whereas  h  becomes  shorter  immediately  at  the  initiation  of  pronation  (30).  We 
must  assume,  at  this  time,  that  our  model  is  valid  regarding  h  relationship  to  C  toler¬ 
ance,  regardless  of  the  direction  of  the  reclining  subject — whether  supine  or  prone. 


Figure  8.  Change  in  eye-heart  vertical  distance  (d)  with  supina¬ 
tion  (d2)  or  pronation  (d^) .  RA'=  retinal  -  aortic 
line;  and  AZ  =  anatomical  *  (longitudinal)  axis  (30) . 


Since  maximum  G-tolerance  studies  with  subjects  in  the  prone  position  have  never 
been  performed;  the  relationship  between  this  position,  anti-G  suit  inflation,  and  AGSM 
with  or  without  assisted  PPB,  is  unknown.  Generally,  studies  in  these  more  reclined  or 
pronated  postures  have  been  concerned  only  with  "relaxed"  tolerances,  usually  without  the 
anti-G  suit.  In  order  to  validate  this  model  above  9  G,  carefully  planned  studies  defin¬ 
ing  the  roles  of  various  G  protective  systems  (as  each  acts  alone  and  interacts  with  the 
other  systems)  must  be  conducted.  Only  then  can  we  define  the  maximum  G  levels  possible 
for  humans  using  proven  G  protective  methods.  However,  our  present  level  of  understand¬ 
ing  suggests  that  man  can  tolerate  15  G  with  a  reduced  h.  Consequently,  it  i<=  doubtful 
that  any  aircraft  in  our  lifetime  will  perform  at  a  maneuvering  level  at  which  the 
pilot,  if  properly  protected  by  using  known  anti-G  protective  systems,  will  limit  air¬ 
craft  performance. 


G- INDUCED  FATIGUE 

Until  recently,  tolerance  to  increased  G  had  a  single  dimension  that  was  only  G 
level.  The  amount  of  time  (duration)  that  a  pilot  could  tolerate  an  increased  G  environ¬ 
ment  was  not  considered.  Even  today,  pilot  limitation  to  the  G  environment  is  recognized 
primarily  as  a  G-level  phenomenon.  The  importance  of  fatigue  and  the  interest  in  its 
relation  to  G  level  tolerance  have  increased  recently,  however,  because  of  the  caoability 
of  operational  high  performance  aircraft  that  can  sustain  a  high  G  envirom  •.■ni  (9  G)  for 
protracted  periods  (31-33)  . 

Fatigue,  as  an  acceleration  tolerance  criterion,  is  usually  measured  on  the  cen¬ 
trifuge  using  a  stylized  aerial  combat  maneuver  (SACM)  G  profile.  This  profile  maintains 
the  same  alternating  levels  of  G  until  the  subject  can  no  longer  continue  because  of 
exhaustion  (31;  Fig.  9).  Since  fatigue  can  clearly  limit  human  tolerance  to  the  high  G 
environment,  is  it  then  possible  for  duration  tolerance  (fatigue)  to  make  the  pilot  the 
limiting  factor  in  high  performance  aircraft?  The  answer,  as  with  the  presumed  G  level 
tolerance  limiting  factor,  is  a  resounding  not 

There  are  four  reasons  why  pilot  fatigue  tolerance  can  be  significantly  increased: 
(a)  G-level  tolerance  and  G-duration  tolerance  are  tightly  coupled,  so  that  increasing  G- 
level  tolerance  increases  G  duration  tolerance;  (b)  a  reduction  in  the  effort  required 
to  increase  the  Pj  (such  as  with  assisted  PPB)  increases  G-duration  tolerance;  (c)  an 
improved  ability  to  increase  Pj  (such  as  with  anaerobic  muscle-strength  physical  condi¬ 
tioning)  increases  G-duration  tolerance;  and  (d)  improved  physiologic  support  with  an 
improved  anti-G  suit  also  increases  G-duration  tolerance.  The  last  three  increase  G- 
duration  tolerance  without  necessarily  increasing  G-level  tolerance;  i.e.,  thus  demon¬ 
strating  that  G-duration  is  a  different  tolerance  dimension. 

G-level-duration  Tolerance  Coupling: 


Burton  and  Shaff stall  (31)  reclined  subjects  to  65°  supine,  and  exposed  them  to 
the  SACM  until  fatigued  (Fi^,  10).  A  direct  coupling  between  relaxed  G-level  tolerance 


and  G-duration  tolerance  is  clearly  demonstrated.  Therefore,  as  G-level  tolerances  are 
increased  with  advanced  protective  methods  (as  discussed  previously  in  this  article) ,  G 
duration  tolerance  will  also  increase.  On  the  other  hand,  as  subjects  become  fatigued, 
their  ability  to  perform  an  AGSM  is  diminished,  so  their  G-level  tolerance  is  reduced. 
This  reduction  in  G-level  tolerance  has  been  estimated  to  be  approximately  1  G  for  each 


30  s  of  ACM  (33) . 
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Figure  9.  Simulated  aerial  combat  maneuver 
(SACM)  used  on  the  centrifuge  to 
quantify  G-duration  tolerance  (31)  . 
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Figure  10.  Relaxed  G  tolerances  are  com¬ 
pared  with  SACM  tolerances  at 
four  seat  back  angles  (31) . 


Improved  Methods  to  Increase  PT : 

Assisted  PPB  at  30  mmHg  has  been  shown  to  increase  G-duration  tolerance  to  the 
SACM  by  35%  (34) .  Higher  levels  of  assisted  PPB  of  50-70  mmHg  increased  G-duration  tol¬ 
erance  to  a  +5?  to  +9Z  SACM  by  110%  and  72%,  respectively  (28).  Additionally,  the  G- 
tolerance  coupling  between  G-level  and  G-duration  is  particularly  evident  in  assisted 
PPB.  As  discussed  earlier  in  this  text,  assisted  PPB  gave  pilots  what  they  considered  was 
a  "2  G"  advantage  that  significantly  reduced  their  fatigue  level. 

Improved  Ability  to  Increase  PT : 

Physical  conditioning,  by  improving  anaerobic  capacity  and  muscular  strength,  has 
been  shown  in  three  separate  studies  to  increase  G-duration  tolerance — in  one  study  by  as 
much  as  77%  (35-37).  The  Air  Standardization  Coordinating  Committee  (ASCC) ,  Working  Party 
61  is  in  the  process  of  adopting  an  Advisory  Publication  61/1031  "Physical  Fitness  and  G 
Tolerance"  that  proposes  methods  of  strength  training  and  increasing  anaerobic  capacity 
for  pilots  to  increase  their  ACM  tolerance.  The  U.S .  Air  Force  { USAF )  and  U.S.  Navy  (USN) 
are  coordinating  efforts  to  develop  a  common  physical  conditioning  regime.  In  a  recent 
field  study,  USN  pilots  found  anaerobic  and  muscular  conditioning  particularly  beneficial 
in  improving  their  ACM  tolerance  (39)  .  The  USAF  encourages  pilots  of  high  performance 
aircraft  to  participate  in  muscle-strength  building  activities. 

Improved  Anti-G  Suit: 

The  anti-G  suit  was  modified  by  increasing  the  leg  support  with  uniform  coverage 
of  the  entire  leg,  instead  of  the  "spotty"  bladder  leg  pressurization  of  the  operational 
anti-G  suit.  This  suit  modification  increased  SACM  tolerance  133%  (Fig.  9) — subjects  were 
now  capable  of  497  s  of  the  SACM,  as  compared  with  only  213  s  with  the  standard  anti-G 
suit  (38)  . 

During  the  SACM,  heart  rates  in  subjects  with  this  suit  also  were  significantly 
reduced.  Since  the  only  modification  in  this  suit  was  improved  support  for  venous  return, 
this  physiologic  parameter  in  the  development  of  fatigue  during  the  SACM  has  become  a 
very  important  consideration  in  anti-G  suit  design. 

The  physiologic  importance  of  venous  return  during  prolonged  exposures  to  high  G 
levels  is  much  greater  than  during  short  duration  exposures  to  G.  For  this  reason,  the 
leg  support  of  the  anti-G  suit  in  increasing  "relaxed"  G  tolerance  is  insignificant,  but 
leg  pressurization  is  most  effective  during  high  sustained  G  (HSG)  exposures  in  signifi¬ 
cantly  reducing  heart  rate  (39) . 

Good  evidence  shows  that  venous  return,  because  of  blood  pooling,  is  G- tolerance 
limiting  during  sustained  exposures  to  high  G — a  physiologic  problem  that  apparently  is 
net  an  issue  during  short  duration  exposures  to  G.  This  phenomenon  appears  to  be  caused 
by  "delayed  compliance,"  induced  by  venomotor  fatigue,  visco-elastic  effects  in  the 
venous  walls  and,  possibly,  recruitment  of  peripheral  vessels  due  tj  the  change  in  pres¬ 
sure  (14).  The  delayed  compliance  response  accounts  for  a  significantly  greater  volume 
change  than  the  rapid  elastic  distension  that  occurs  at  the  initiation  of  increased  G. 

In  support  of  this  venous  system,  particularly  during  the  delayed  compliance 
response  which  tends  to  reduce  venous  return,  adequate  venous  wall  pressure  support  is 
required  and  can  be  managed  with  a  uniform  pressure  anti-G  suit.  This  concept  has  now 


been  incorporated  into  a  prototype  anti-G  suit,  using  a  single  bladder  design;  and 
encouraging  results  are  reported  by  the  laboratory. 
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CONCLUSIONS 

At  the  present  time,  we  must  assume  that  the  pilot  with  current  operational  pro¬ 
tection  is  probably  the  limiting  factor  in  high  performance  aircraft.  This  assumption  wa 
demonstrated  in  a  recent  flight  test  of  assisted  PPB  at  the  Air  Force  Flight  Test  Center 
(AFFTC) ,  Edwards  AFB,  California,  where  pilots  of  the  F-15  or  F-16  were  reluctant  to  fly 
aerial  combat  maneuvers  (ACM)  against  each  other  unless  they  both  had  assisted  PPB.  The 
pilots  thought  they  had  a  2-G  advantage,  and  were  much  less  fatigued  with  this  improved 
anti-G  protective  system:  assisted  PPB. 

Fortunately,  the  pilot  need  not  be  the  limiting  factcr,  as  that  scenario  clearly 
demonstrates.  In  this  article,  we  have  shown  that  pilot  acceleration  protection  technolo 
gies  are  apparently  available  to  potentially  extend  tolerance  into  the  12  to  15  G  regime 
Developing  and  incorporating  these  technologies  into  operational  systems  will  produce  a 
real  advantage  in  air  combat  as  currently  conceived.  But  in  this  regard,  more  time  is 
needed,  because  the  basis  for  G  protection  is  reducing  the  eye-heart  vertical  distance — 
an  undertaking  that  will  require  a  serious  commitment  by  engineers  who  design  and  build 
airplanes,  x’hat  commitment  will  no  doubt  be,  for  them,  a  significant  challenge;  but 
increased  aircraft  performance,  enabled  by  improved  pilot  performance,  should  amply 
reward  their  efforts. 
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SUMMARY 

This  paper  summarises  some  o£  the  problems  which  are  typically  encountered  when 
viewing  displays  in  the  military  cockpit.  It  is  suggested  that  design  and  development  of 
display  configurations  can  be  made  quicker,  cheaper,  and  more  effective  than  present 
methods  by  using  mathematical  models  of  the  man-display  interface  to  predict  visual 
performance.  The  requirements  for  such  models  are  discussed.  A  state-of-the-art  model 
which  has  been  developed  at  British  Aerospace  is  reviewed.  The  model  comprises  spectral 
manipulation  routines  to  calculate  how  the  emission  spectrum  from  a  display  is  modified 
before  reaching  the  eye,  together  with  a  psychophysical  vision  model  which  provides  an 
objective  measure  of  visibility.  The  benefits  of  using  such  a  model  are  described. 
Finally,  suggestions  are  made  for  future  work  to  extend  the  present  models.  A  detailed 
description  is  not  given  of  the  calculations  in  either  part  of  the  model  but  further 
information  may  be  obtained  from  the  references  or  by  contacting  British  Aerospace, 
Sowerby  Research  Centre. 


1.  INTRODUCTION 

British  Aerospace  (BAe)  is  a  major  producer  of  civil  and  military  aircraft,  guided 
missile  systems  for  air,  land  and  sea  use,  and  also  satellites  and  space  platforms.  The 
company  thus  has  a  wide  and  varied  interest  in  many  types  of  displays.  Of  particular 
importance  are  displays  for  use  in  the  military  cockpit.  For  a  number  of  years  work  has 
been  carried  out  within  the  Military  Aircraft  Divisions  and  at  BAe ' s  corporate  research 
centre  (the  Sowerby  Research  Centre  (SRC))  with  the  aim  of  improving  methods  to  solve 
problems  with  the  visual  perception  of  displays  in  cockpits. 

Colour  displays  form  an  integral  part  of  modern  fighter  cockpits.  Complex 
information  has  to  be  presented  so  that  it  can  be  assimilated  easily  and  acted  upon. 
Various  forms  of  coding  are  used,  the  dominant  ones  being  shape,  size  and  luminance. 
Colour  is  mainly  used  to  de-clutter  displays.  To  gain  full  advantage  of  colour  displays 
and  avoid  their  use  for  purely  aesthetic  reasons,  the  benefits  of  using  colour  need  to  be 
quantified. 

There  are  many  problems  with  displays  in  cockpits.  In  addition  to  the  physical 
problems  of  size,  weight,  power  consumption  and  reliability,  display  legends  must  appear 
legible,  clear,  and  of  a  required  colour  in  very  high  ambient  lighting  conditions.  They 
must  also  perform  satisfactorily  in  low  ambient  conditions  without  adversely  affecting 
vision  through  night  vision  goggles. 

At  British  Aerospace  we  believe  that  the  way  forward  lies  in  modelling  the 
man-display  interface  mathematically  and  attempting  to  define  quantitatively  the 
performance  required  of  it.  A  better  understanding  of  visual  performance  and  efficient 
use  of  modelling  techniques  will  reduce  time  and  costs  for  equipment  development  and 
improve  the  man-display  interface. 


2 .  BACKGROUND 

A  pilot  must  be  able  at  all  times  to  interface  effectively  with  both  the  outside 
world  and  the  various  displays  within  the  cockpit.  His  attention  will  be  divided 
visually  between  the  two  as  the  situation  demands.  It  is  therefore  essential  that 
neither  environment  inhibits  his  view  of  the  other,  i.e.  they  produce  the  same  degree  ol 
relative  visibility.  When  flying  during  the  day  the  external  environment  will  tend  to 
dominate  and  conversely  at  night  it  is  the  cockpit  displays  which  will  appear  bright  to 
the  aetriment  of  the  pilot's  perception  of  the  world  outside. 

Clearly,  neither  the  pilot's  vision  system  nor  the  external  ambient  conditions  can 
be  changed,  therefore  it  is  the  cockpit  display  configuration  (including  the  complete 
display  environment  and  viewing  aid  or  visor)  which  must  be  designed  to  compensate  for 
the  limitations  of  the  pilot's  visual  capability  and  those  imposed  by  the  ambient 
lighting  conditions.  The  real  world  natural  ambient  illumination  is  both  too  varied  and 
too  complex  for  every  condition  to  be  considered  in  the  design  of  displays.  A  compromise 
solution  is  thus  sought  whereby  a  display's  performance  is  modelled  in  limiting  ambient 
conditions;  if  it  is  found  to  be  acceptable  then  it  is  assumed  to  perform  satisfactorily 
under  other  conditions. 

Practical  flight  experience  has  identified  two  high  ambient  steady  state  limiting 
cases  when  display  performance  will  be  most  severely  tested.  These  are  both  associated 


with  a  low  elevation  bright  solar  disc.  The  first  is  when  flying  away  iron,  the  sun 
('sun  rear')  and  direct  solar  illumination  reflected  from  the  display  lace  causes  a 
reduction  of  luminance  contrast  and  desaturation  of  colours  on  the  display.  The  second 
case  is  when  flying  towards  the  sun  ('sun  forward')  as  direct  solar  glare  reduces  the 
pilot's  perceptual  capability,  thus  degrading  the  appearance  oi  the  display. 

A  common  way  of  alleviating  the  problem  of  the  sun  rear  case  is  to  place  in  front  of 
the  display  a  contrast  enhancement  filter  with  an  anti-reflection  coating.  This  may  be  a 
narrow  bandpass  absorption  filter  matched  to  the  display's  spectral  output  so  that, 
ideally,  it  absorbs  all  wavelengths  incident  on  it  apart  from  those  emitted  by  the 
display.  For  the  sun  forward  case  the  problem  of  solar  glare  on  the  pilot's  visual 
perception  can  only  be  overcome  by  a  very  bright  display  output,  i.e.  if  a  contrast 
enhancement  filter  is  used  it  must  have  a  high  transmission. 

Low  ambient  conditions  pose  different  problems.  External  vision  is  enhanced  by  the 
use  of  night  vision  goggles  (NVGs)  which  amplify  electromagnetic  radiation  between  400 
and  900  nm  and  reproduce  the  scene  as  a  single  phosphor  image.  Using  NVGs  the 
operational  limitation  on  the  aircraft  to  perform  a  low-level,  high-speed  role  can  be 
extended  from  dusk  or  bright  moonlight  down  to  the  starlight  environment.  NVGs  have  a 
limited  depth  of  focus,  therefore  cockpit  displays  must  be  viewed  with  the  naked  eye. 
The  brightness  of  the  NVG  image  will  be  too  great  for  the  pilot  to  achieve  scotopic  (rod) 
vision,  so  displays  must  be  sufficiently  bright  to  be  clearly  legible  photopically , 
though  not  so  bright  as  to  cause  flare  in  the  NVGs.  Unfortunately,  just  controlling 
display  luminances  is  not  sufficient,  as  emissions  from  displays  at  wavelengths  to  which 
the  NVGs  are  sensitive  can  produce  unwanted  glare  and  wash  out  the  reproduced  image  of 
the  external  scene.  Display  outputs  must  therefore  be  carefully  matched  to  NVG 
performance . 

The  requirements  for  the  three  cases  (sun  rear,  sun  forward,  and  night)  are  thus 
contradictory  and  display/filter  combinations  which  satisfy  one  requirement  may  nut 
perform  well  in  the  ethers.  A  compromise  is  needed  which  will  perlorm  reasonably  well  in 
all  conditions.  Mathematical  modelling  enables  the  design  engineer  to  evaluate  the 
various  compromise  options  in  an  objective  way  and  find  the  optimum  solution  available 
for  a  specific  case,  judging  performance  against  cost. 

Without  an  objective  measure,  the  engineer  must  base  his  design  on  the  last 
generation  of  displays  and  his  personal  experience.  The  prototype  display  configuration 
enters  an  iterative  subjective  evaluation  loop  as  it  is  assessed  by  experienced  aircrew, 
reviewed  and  modified,  then  submitted  for  reassessment.  This  method  is  tried  and  tested 
and  generally  produces  some  level  of  acceptance,  although  it  can  be  both  time  consuming 
and  expensive.  The  other  main  problem  with  this  technique  is  that,  as  it  involves 
subjective  evaluation,  it  is  obviously  dependent  on  the  visual  acuity  and  experience  of 
the  pilots  performing  the  assessment.  If  the  system  can  be  modelled  for  the  average 
pilot,  including  observer  variability,  and  an  objective  ’figure  of  merit’  provided,  then 
it  should  be  possible  to  increase  the  probability  of  first  time  acceptance,  i.e.  reduce 
the  number  of  iterations  by  dismissing  unsuitable  configurations  without  the  need  for 
repeated  costly  flight  trials. 

The  man-display  interface  essentially  consists  of  two  parts  which  must  be 
represented  mathematically.  The  first  covers  all  physical  interactions  with  the  object's 
emission  spectrum  from  leaving  the  display  to  entering  the  eye.  The  second,  psycho¬ 
physical,  part  deal  with  the  visual  interpretation  of  this  spectrum  within  the  eye.  Of 
these  two,  the  physical  part  is  easier  to  model  as  it  consists  of  well-defined 
calculations  for  the  various  spectral  paths  leading  to  the  eye.  The  psychophysicaL  part 
presents  more  of  a  problem.  The  C1E  (International  Commission  on  Illumination)  has 
defined  equations  for  evaluating  the  colour  difference  between  an  object  and  its 
immediate  background  (Refs.  1  and  2].  One  of  the  recommended  colour  spaces  for  colour 
difference  calculation  is  the  CIELUV  space.  The  total  difference  AE*  between  two  colours 
in  the  CIELUV  space  is  defined  as  the  vector  distance  between  them: 

AE*  =  [(AL*)2  +  (Au*)2  +  (Av*)*p  (1) 

where:  L*  is  psychometric  lightness; 

u*  and  v*  are  components  of  perceived  chroma. 

Unfortunately,  the  presently  available  equations  are  only  applicable  to  small  colour 
differences  and  large  uniform  objects  and  are  therefore  not  relevant  to  most  real  tasks, 
which  may  involve  small,  irregular,  brightly  coloured  objects  on  cluttered  backgrounds. 
The  size  of  the  object  is  not  given  as  a  variable,  although  it  obviously  has  an  effect  on 
visual  performance.  There  are  several  other  important  factors  which  will  allect  the 
perception  of  the  object,  including  the  quality  of  display  and  the  type  and  complexity  ol 
the  task  being  performed,  none  of  which  are  included  in  the  simple  CIE  equations.  To 
include  all  of  these  factors  requires  a  sophisticated  vision  model. 

For  a  number  of  years  the  Sowerby  Research  Centre  has  been  developing  and  refining 
models  to  predict  thresholds  of  visual  performance  for  a  variety  of  tasks.  The  models 
can  handle  a  wide  range  of  visual  tasks  from  the  detection  of  simple  stimuli  on  uniform 
backgrounds  to  form  perception  and  visual  search  in  noisy  or  cluttered  background  scenes. 
The  modelling  is  based  on  the  results  of  laboratory  studies  and  field  trials,  and  the 
known  physiology  of  the  eye. 

One  of  the  models,  ORACLE  [Ref.  3],  has  been  developed  as  a  threshold  model  for 


stimuli  with  simple  profile  structures  and  little  internal  texture.  ORACLE  provides  a 
probability  of  detection  for  an  object  by  comparing  retinal  cone  responses  for  the  object 
and  its  immediate  background.  A  detailed  description  of  the  ORACLE  model  is  beyond  the 
scope  of  this  paper  but  details  of  the  equations  may  be  found  in  References  U  and  5. 

As  well  as  using  the  basic  information  about  an  object  (Luminance  contrast, 
chrominance  difference,  size  and  shape),  ORACLE  takes  into  account  other  factors  such  as: 

(a)  Foveal  and  peripheral  performance  -  This  is  based  on  a  comparison  of  receptor 
responses  across  the  regions  of  maximum  illuminance  gradient  of  the  image,  i.e. 
along  the  object's  perimeter.  ORACLE  models  performance  based  on  the  length  and 
strength  of  the  perimeter  imaged  on  the  retina. 

(b)  Mean  scene  luminance  -  This  determines  pupil  diameter,  which  controls  the  amount  of 
energy  falling  on  the  retina. 

(c)  Search  -  The  modelling  of  peripheral  detection  allows  search  performance  to  be 
predicted. 

(d)  Observer  variability  -  Statistical  variations  due  to  normal  observer  populations  are 
included. 

(e)  Object  movement  -  It  is  possible  to  model  the  effects  of  retinal  image  motion  on 
performance . 

(1)  Image  quality  -  ORACLE  can  model  the  effects  of  viewing  imperfect  images  blurred  by 
optics  or  discretely  sampled  by  noisy,  raster  type  displays.  A  visual  efficiency 
term  is  calculated  which  relates  image  quality  of  the  total  system  (including  eye) 
to  that  of  the  eye  alone.  Image  quality  is  defined  in  terms  of  a  modulation 
transfer  function  (MTF)  varying  with  spatial  frequency. 

(g)  Complexity  of  task  -  The  most  simple  visual  task  is  the  detection  of  an  object 
against  a  uniform  background.  For  most  real  tasks  some  degree  of  discrimination 
must  be  made  between  the  object  and  potentially  confusable  background  objects.  This 
is  included  in  the  model  by  looking  at  detection  of  a  part  of  the  object. 
Increasing  levels  of  task  complexity  are  modelled  by  considering  smaller  fractions 
of  the  target  perimeter,  as  more  detail  must  be  resolved. 

(h)  Spatial  and  temporal  integration  -  ORACLE  models  the  effective  interaction  of 
the  spatial  and  temporal  integration  of  a  display  with  that  of  the  visual  system. 
This  allows  consideration  of  factors  such  as  phosphor  persistence,  raster  decay 
properties  and  refresh  rates,  random  and  systematic  noise,  sampling  pitch,  spot 
profiles,  and  display  MTFs  in  vertical  and  horizontal  directions. 

ORACLE  was  originally  developed  as  a  threshold  achromatic  model  and  this  is  now  well 
validated,  however,  it  has  only  recently  been  extended  to  consider  both  colour  and 
suprathreshold  objects.  Thus  it  is  still  undergoing  validation  in  these  areas  and  the 
data  to  test  it  fully  are  only  now  being  obtained.  Although  ORACLE  has  been  used 
successfully  to  model  various  optical  sights,  a  version  which  considers  the  use  of  NVGs 
is  not  available  at  present.  The  present  form  of  ORACLE  is  thus  not  an  ideal,  fully 
comprehensive  vision  model,  but  it  is  representative  of  the  state-of-the-art  and  is  a 
versatile  and  useful  design  tool. 

For  complex  stimuli  (highly  textured  objects)  a  computer  simulation,  called  VISIVE 
[Ref.  b ] ,  is  used  to  model  the  known  early  interactive  neural  processes  in  the  retina  and 
striate  cortex.  VISIVE  provides  a  method  of  characterising  or  coding  stimulus 
information  in  a  similar  manner  to  that  which  is  believed  to  be  available  for 
interpretation  in  the  brain.  The  modification  of  the  stimulus  by  VISIVE  can  be  used  as 
an  objective  input  to  ORACLE.  The  amount  of  processing  performed  by  VISIVE  is  quite 
considerable  which  means  that  it  can  only  be  implemented  on  a  mainframe  computer. 

A  simple  empirical  psychophysical  model  has  already  been  shown  to  be  useful  in 
assessing  the  performance  of  displays  in  the  cockpit.  This  model  is  based  on  the  concept 
oi  the  'Perceived  Just  Noticeable  Difference'  (PJND)  [Ref.  7]  and  is  similar  in  approach 
to  RAE  Farnboiough'  s  ’IDEAL'  display  design  tool  [Ref.  8].  1  PjND  is  the  threshold 

colour  difference  (composed  of  both  luminance  and  chrominance  differences)  required  to 
just  detect  an  object  from  its  background.  Above  this  threshold  condition  (which  may  be 
achieved  by  an  infinite  variety  of  luminance  and  chrominance  combinations),  the  colour 
difference  between  the  foreground  and  background  is  equivalent  to  a  number  of  PJNDs 
greater  than  one. 

No.  PJNDs  =  I (No.  LJNDs ) 2  +  (No.  GJNDs)*]2  (2) 

where:  No.  LJNDs  is  the  number  of  luminance  just  noticeable 
differences  -  log  (Luminance  ratio) 

log  (Threshold  luminance  ratio) 


No.  CJNDs  is  the  number  of  chrominance  just  noticeable 
differences  =  Chrominance  contrast 


chrominance  contrast 


Chrominance  contrast  is  measured  in  the  CIE  1976  DCS  diagram.  Threshold  contrasts  for 
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both  luminance  and  chrominance  are  functions  of  obiect  size  ana  background  luminance. 

Assuming  that  suprathreshold  visibility  increases  with  CIE  colour  difference,  then 
for  a  greater  number  of  PJNDs,  a  greater  degree  of  visibility  will  be  expected.  Thus  it 
is  possible  to  relate  visibility  to  a  directly  measurable  quantity.  Experiments  using 
calibrated  stimuli  in  a  representative  environment  have  determined  ranges  of  acceptable 
PJNDs  for  various  tasks.  The  model  is  limited  in  terms  of  the  object  sizes  to  which  it 
is  applicable  and  also  assumes  that  the  C1E  1976  UCS  is  uniform. 

The  PJND  concept  has  been  combined  with  the  physical  manipulation  of  spectra  to 
provide  a  simple  system  model.  This  model  is  being  used  for  designing  display  systems  in 
a  number  of  aircraft  (Tornado,  Jaguar,  Harrier,  EAP) .  However,  it  is  severely  restricted 
by  the  limitations  of  the  simple  PJND  approach.  The  model  introduced  in  this  paper 
extends  this  basic  model,  making  it  more  flexible  and  generally  applicable  by  adding  a 
version  of  ORACLE.  The  use  of  such  a  versatile  ana  comprehensive  model  incorporated  with 
the  display  system  and  environmental  model  greatly  extends  conventional  and  recommended 
methods  tor  evaluating  colour  and  luminance  differences.  In  particular,  such  a  model 
will  allow  display  characteristics  and  other  components  of  the  man-display  interface  to 
be  optimised  as  functions  of  object  size  and  shape,  peripheral  viewing  angle,  observer 
task  etc. 


3.  REQUIREMENTS  OF  A  MATHEMATICAL  MODEL 

Figure  1  shows  the  basic  elements  required  for  a  man-display  interface  model.  The 
lirst  is  a  display  model  to  calculate  the  spectral  output  of  a  display  for  an  object  and 
its  background.  The  second  is  a  physical  model  to  calculate  how  the  display  output  is 
altered  in  both  luminance  and  chromaticity  before  reaching  the  eye.  A  vision  model  is 
then  needed  to  calculate  the  perceived  difference  between  the  object  and  its  background. 
Finally,  this  must  be  interpreted  by  cognitive  user  model,  taking  into  account 
workload,  task,  experience  etc.,  before  an  evaluation  of  the  system  can  be  made.  Not  all 
elements  of  this  system  model  exist  at  present.  In  particular,  a  model  which  can  account 
for  the  cognitive  aspects  of  vision  is  not  available,  and  vision  models  are  generally  at 
an  early  stage  of  development.  Until  suitable  cognitive  models  become  available  it  will 
be  necessary  to  use  empirical  metrics  to  evaluate  display  systems  (for  example,  the  C1E 
system,  the  PJND  method  or  empirical  use  of  ORACLE  output). 


FIGURE  1.  SCHEMATIC  OF  MANOISPLAY  INTERFACE  MODEL 

For  a  man-display  interface  model  to  have  as  wide  an  application  as  possible  it 
should  cover  the  complete  range  of  cockpit  displays,  including  emissive  (ranging  from 
light  emitting  diode  or  incandescent  lamp  captions  to  multi-function  full  colour  cathode 
ray  tubes),  reflective  (liquid  crystal  displays)  and  transmissive  (head-up  and  helmet 
mounted  displays)  technologies. 

The  model  should  consider  the  environmental  extremes  of  uay-tinie  and  night-time 
viewing.  For  these  two  conditions  performance  requirements  must  be  specif ieu  it: 
different  ways.  In  high  ambient  conditions  a  measure  is  needed  of  the  relative 
visibility  of  an  object  (e.g.  display  legend)  with  respect  to  its  immediate  background. 
At  low  ambient  it  is  important  that  aisplays  are  sufficiently  bright  to  be  viewed 
photopically  with  the  naked  eye,  whilst  not  being  so  bright  as  to  saturate  the  NVGs .  Ihc 
critical  measure  is  thus  the  ratio  ol  the  perceived  brightness  of  the  object  as  viewed 
with  the  naked  eye  to  its  perceived  brightness  viewed  through  NVGs. 

A  versatile  form  of  tKe  model  would  be  a  program  written  in  a  high  level  language, 
composed  of  programming  modules  and  implemented  on  a  common  micro-computer .  Th-  vet. Id 


enable  the  model  to  be  w:dely  available,  portable,  and  easy  to  update  as  new  data  become 
available  or  addit ional/alternative  specifications  are  established.  In  addition,  input 
requirements  should  be  clear,  and  preferably  absolute  measurement  data  derived  irons  the 
display  or  the  component  parts  making  up  the  interface,  while  outputs  must  be  easy  to 
interpret  and  compare  with  specification  requirements,  e.g.  oy  providing  a  table  of 
tyK;  '  lly  acceptable  model  visibilities  for  various  tasks. 


4.  STRUCTURE  OF  THE  MODEL 

The  model  is  implemented  on  an  IBM  PC.  It  is  programmed  in  Pascal,  which  supports  a 
suitaDle  modular  form  to  allow  easy  updating  without  disrupting  the  basic  torn,  of  the 
model . 

The  two  halves  of  the  interface  (shown  in  Fig.  1)  are  treated  separately;  the 
display-to-eye  part  by  a  physical  model  composed  of  spectral  calculations  arid  the  eye's 
interpretation  by  ORACLE. 

Whilst  effort  has  been  given  to  making  the  model  reasonably  straightforward  to  use, 
with  simple  menu-based  options,  it  is  not  an  'expert  system'  ana  does  require  a 
reasonable  amount  of  experience  of  this  sort  of  problem  to  be  used  effectively. 


5.  PHYSICAL  MODEL 

This  model  calculates  how  display  emissions  are  modified  before  reaching  the  pilot's 
eyes,  thus  establishing  the  spectral  power  distributions  representing  the  display 
foreground  and  background  as  they  enter  the  eyes.  At  present  the  model  is  limited  to 
consideration  of  emissive  devices  on1y,  however,  it  is  planned  to  extend  it  to  include 
both  reflective  and  transmissive  displays.  Although  capable  of  considering  any  ambient 
illumination  condition,  the  model  is  configured  to  represent  only  the  two  limiting  high 
ambient  cases,  sun  rear  and  sun  forward.  Table  1  shows  the  conditions  associated  with 
these  cases  in  the  Tornado  cockpit. 

Table  1.  High  ambient  limiting  conditions  for  Tornado 


Sun  Rear 

Sun  Forward 

Solar  elevation 

Eye  illumination 

Display  illumination 
Heimet  visor 

30  deg 
12,500  Lux 
94,000  Lux 

Up 

15  deg 
109,000  Lux 
6,500  Lux 
Down 

It  is  theoretically  possible  to  consider  every  conceivable  spectral  path,  however, 
to  simplify  programming  tne  model  has  been  limited  to  the  primary  paths  only.  Figures  2 
and  3  show  schematics  of  the  spectral  light  paths  involved  with  these  two  conditions. 
The  calculations  involve  modelling  transmission  of  the  object  and  background  spectra 
through  filters,  the  inclusion  o f  glare  and  reflections  from  both  the  display  lace  and 
around  the  cockpit.  Each  of  these  simple  stages  is  performed  by  a  separate  programming 
module,  to  allow  easy  reconfiguration  by  replacing,  adding  or  removing  modules.  One 
module  calculates  the  resultant  spectrum  alter  being  transmitted  through  a  filter  and 
another  calculates  how  a  spectrum  is  modified  by  reflection  from  a  surface.  Other 
modules  perform  simple  arithmetic  operations  such  as  addition  or  multiplication.  When 
looking  at  the  effects  of  glare,  both  specular  light  from  the  solar  disc  and  diffuse 
illumination  from  the  sky  dome  must  be  considered.  Both  of  these  contr iKut ions  are 
included  in  a  glare  modul°,  using  equations  based  on  those  in  Reference  Q.  Figure  4 
shows  an  example  block  diagram  containing  calculation  modules  for  the  sun  rear  case  (see 
also  Fig.  2).  Note  that  emission  spectra  are  normalised  to  give  a  luminance  of  1  Cd/m2 
when  stored  and  therefore  need  to  be  multiplied  by  their  respective  emission  levels 
before  use.  Output,  in  the  form  of  calculated  Luminance  and  chromaticity  ‘oordinates, 
may  be  obtained  at  any  point  in  the  calculation,  allowing  termination  of  the  model  before 
completing  the  full  calculation.  This  may  be  a  useful  feature  when  optimising  a  single 
part  of  the  interface,  such  as  a  filter. 
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The  model  assumes  that  the  pilot  will  use  his  helmet  visor  to  gain  relief  from 
direct  solar  glare  in  the  sun  forward  case.  The  display  arrangement  can  be  set  up  to 
represent  either  displays  in  the  head-up  area,  where  solar  glare  will  be  most  disruptive, 
or  in  the  general  head-down  position,  where  glare  will  be  less  critical.  It  should  be 
noticed  that  specular  reflections  of  the  pilot's  flying  suit  may  be  caused  on  the  display 
face,  having  implications  on  the  colours  worn. 

The  required  spectral  inputs  are: 

(a)  Emission  source. 

(b)  Solar  radiation  (defined  in  program). 

(c)  Diffused  sky  radiation  (defined  in  program). 

(d)  Transmission  of  canopy  (defined  in  program). 

(e)  Diffuse  reflectivity  of  display. 

(f)  Specular  reflectivity  of  display. 

(g)  Transmission  of  contrast  enhancement  filter  (if  used). 

(h)  Transmission  of  helmet  visor  (defined  in  program). 

(i)  Reflectivity  ot  flying  suit  (defined  in  program). 

( j )  General  reflectivity  of  cockpit  (defined  in  program). 

An  additional  input  is  the  angle  subtended  at  the  eye  between  the  horizontal  and  the 
display.  This  specifies  where  in  the  cockpit  the  display  is  positioned  and  hence  the 
effect  of  glare. 

The  main  outputs  are  the  spectra  for  the  object  and  its  background  which  are  used  as 
input  for  ORACLE.  As  a  secondary  output,  the  number  of  PJNDs  between  the  object  and  its 
background  is  calculated  (see  Section  2),  which  may  be  used  as  at)  indication  of  display 
performance,  though  for  a  more  rigorous  evaluation  ORACLE  should  be  used  to  calculate 
visibility. 


6.  PSYCHOPHYSICAL  MODEL,  ORACLE 

The  version  ot  ORACLE  which  has  been  implemented  in  this  model  is  for  basic  object 
detection  and  visibility  calculation.  It  does  not  include  such  refinements  as  object 
motion  or  the  consideration  of  optical  sights  (though  these  may  be  include  later  if  the 
need  for  it  is  identified) . 

The  inputs  to  the  model  are: 

(a)  Object  and  background  spectra. 

(b)  Peripheral  angle  (less  than  2  degrees  for  foveal  detection). 

(c)  Mean  scene  luminance. 

(d)  Size  of  object  (in  milliradians ,  mr ,  subtended  at  the  eye). 

(e)  Image  quality. 

(f)  Task  complexity. 

(g)  Time  for  detection  (there  are  two  values  depending  on  whether  the  observer  is 
searching  the  scene  or  fixating  a  point. 

Further  information  on  these  parameters  is  given  in  Section  2. 

The  output  appropriate  to  the  perceived  visibility  of  cockpit  displays  is  not  a 
probability  of  detection  (as  all  object  stimuli  should  be  well  above  threshold),  but 
ORACLE'S  measure  of  suprathreshold  visibility,  which  is  related  to  the  ratio  of  measured 
suprathreshold  contrast  with  threshold  contrast.  The  program  is  written  to  give  graphs 
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and  tables  of  predicted  visibility  against  peripheral  angle.  Using  this  information  it 
can  be  easily  seen  at  which  angle  a  particular  configuration's  performance  may  fail  below 
specification.  At  present  there  is  little  data  available  giving  ranges  of  acceptable 
ORACLE  visibilities  for  various  real  tasks.  To  use  the  model  effectively  these  ranges 
must  be  defined. 
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Object 

Luminance  (Cd/m2) 
200 
200 
200 
soo 

500 

500 

1000 

1000 

1000 


Are*  A(p*ct 
(m f2)  Ratio 

M0  1:1 

U.1  «:1 

2M1  1:1 

M.9  1:1 

Ml  f:1 

2  $4.1  1:1 

M.9  1:1 

Ml  f:1 

2*4.1  1:1 


FIGURE  5.  EXAMPLE  MODEL  OUTPUT  SHOWING  VARIATION  OF  ORACLE  VISIBILITY  WITH 
PERIPHERAL  ANGLE 


Figure  5  shows  curves  obtained  for  some  hypothetical  cases.  The  lines  show  the 
variation  in  visibility  of  a  plain  amber  caption  plotted  against  peripheral  angle  up  to  a 
maximum  angle  of  10  degrees.  Three  object  luminance  levels  and  three  areas  (including 
two  aspect  ratios)  for  the  caption  are  shown.  As  might  be  expected,  greater  visibilities 
are  predicted  tor  larger  sizes  and  higher  luminances.  It  can  be  seen  that  the  fall-off 
in  visibility  with  peripheral  angle  becomes  less  rapid  as  object  size  increases.  Suppose 
that  a  minimum  required  ORACLE  visibility  of  1.8  has  been  specified:  from  Figure  5  it  is 
clear  that  none  of  the  low  luminance  captions  (lines  1,  2  and  3)  would  be  suitable  and 
that  all  of  the  high  luminance  captions  (lines  6,  7  and  8)  would  be  acceptable  when 
presented  within  10°  of  the  instantaneous  point  of  fixation.  Similarly,  the  largest 
medium  luminance  caption  (line  6)  could  be  used  out  to  10°,  but  the  small  and  medium 
sized  medium  luminance  captions  (lines  4  and  5)  would  fall  below  specif ication  at  2°  and 
8°  respectively. 


7.  BENEFITS  OF  MAN-DISPLAY  INTERFACE  MODEL 

The  model  can  be  run  repeatedly  very  quickly  so  many  combinations  of  display 
phosphor  and  contrast  enhancement  filter  can  be  assessed  easily,  rapidly,  and  hence  very 
cheaply.  Of  course,  there  is  still  a  need  for  testing  by  aircrew  in  representative 
environments  and  this  will  remain  ar.  important  design  stage,  but,  if  objective 
specifications  have  been  achieved,  the  system  should  be  close  to  an  acceptable  solution. 

The  use  of  this  model  will  allow  many  more  display  configurations  to  be  tested  than 
it  would  be  practically  feasible  to  assess  by  flight  testing  with  aircrew.  Innovative 
ideas  can  be  evaluated  at  the  initial  design  stage  and,  if  thought  to  be  of  value,  can  be 
developeu  with  the  minimum  of  risk.  Hence,  it  will  enable  designers  to  make  better  use 
of  available  technologies.  Another  major  use  of  the  model  will  be  in  the  drawing  up  or 
equipment  specifications.  Once  the  requirements  for  a  system  have  been  defined  in  terms 
of  working  conditions,  usei  tasks  and  necessary  information  to  be  conveyed,  the 
specification  can  be  given  in  terms  of  an  objective  measure  of  minimum  visibility. 


8 .  THE  FUTURE 

The  model  covered  in  this  paper  represents  the  state-of-the-art  in  display  and 
vision  modelling,  but  there  is  still  work  neeaed  to  achieve  all  the  requirements  set  down 
in  Section  3. 

The  vision  model,  ORACLE,  is  under  continual  review  and  extension.  Presently 
experiments  are  being  carried  out  to  provide  validation  data  for  the  colour  aspects  of 
ORACLE  and  to  investigate  its  suprathreshold  performance.  Preliminary  results  of  one 
current  experiment,  looking  at  suprathreshold  luminance  contrasts  in  high  ambient 
conditions,  show  very  encouraging  correlation  between  ORACLE'S  predicted  visibilities  and 
experimentally  measured  relative  conspicui ties  (see  Fig.  6).  The  method  used  in  this 
experiment  was  by  paired  comparison  of  two  simultaneously  displayed  objects  on  a  computer 
controlled  display.  The  objects  used  were  rectangles  of  different  size  and  aspect  ratio. 
Iwo  levels  of  ambient  illumination  were  used.  It  is  clear  from  the  data  in  Figure  6  that 
objects  ol  varying  luminance  contrast,  size,  and  aspect  ratio  under  different  ambient 
illumination  conditions  can  be  accommodated  by  ORACLE.  These  tesults  confirm  that  ORACLE 
is  a  suitable  model  for  optimising  display  configuration  components  in  aircraft  cockpits, 
where  it  is  necessary  to  judge  objectively  the  combined  effect  on  visual  performance  of 


such  parameters.  Other  work  is  being  carried  out  to  produce  a  module  Lor  ORACLE  to  look 
at  the  effect  of  NVGs  on  observer  performance. 
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ORACLE  PREDICTED  VISIBILITY 


FIGURE  6.  PRELIMINARY  RESULTS  OF  EXPERIMENT  SHOWING  CORRELATION  OF  MEASURED 

RESPONSE  WITH  PREDICTED  VISIBILITY 

The  physical  model  is  presently  limited  to  emissive  displays.  Work  is  therefore 
needed  to  make  it  applicable  to  a  wider  range  of  display  types,  including  coloured  flat 
panel  displays.  To  consider  a  different  type  of  aircraft  presently  requires  the  model 
program  to  be  edited,  as  the  data  used  in  the  equations  for  manipulating  spectra  vary 
with  different  aircraft.  A  menu  selection  for  aircraft  type  could  easily  avoid  the 
necessity  of  changing  the  program  at  code  level. 

A  possible  future  form  of  the  model  could  be  an  'expert  system'  allowing  the  design 
of  a  complete  display  system  and  the  specification  of  any  particular  requirements  for 
visual  performance.  The  model  could  automatically  iterate  different  display /filter 
combinations  to  find  the  optimum  solution(s). 
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SUMMARY 

This  paper  describes  the  flight  test  methodology  that  was  successfully  used  to 
assess  the  effect  of  the  integration  of  a  fighter  aircraft  and  a  specialized  sensor 
augmentation  system  on  pilot  workload  and  single-seat  effectiveness.  This  methodology 
also  permitted  collection  of  subjective  data  pertinent  to  the  issues  of  cockpit  controls 
and  displays,  situational  awareness,  task  complexity,  survivability  and  safety.  Two 
different  subjective  workload  metrics,  supplemented  by  structured  interviews,  formed  the 
basis  of  the  data  collection  procedure.  One  metric  was  the  Subjective  Workload  Assessment 
Technique  (SWAT),  developed  at  Air  Force  Aerospace  Medical  Research  Laboratory 
(AFAMRL),  and  the  other  metric  was  a  modified  Cooper-Harper-type  scale  that  was  tailored 
for  the  project  with  the  inclusion  of  a  performance  factor. 

The  test  method  mandated  that  each  pilot  qualitatively  estimate  attack  performance 
according  to  prescribed  parameters  and  then  use  both  metrics  to  assess  his  perceived 
workload.  Because  we  had  trained  the  pilots  on  the  subjective  methods  to  be  used  during 
the  data  collection  phase,  the  pilots  were  generally  very  comfortable  with  providing  the 
workload  assessments  real  time  (immediately  following  task  accomplishment).  To  elaborate 
on  the  ratings  and  related  comments,  extensive  reviews  and  discussions  of  onboard  video 
were  accomplished  after  flights  among  pilots  and  human  factors  engineers.  This  method 
culminated  in  a  detailed  picture  of  the  integrated  system  with  the  pilot  as  the  key 
system  operator,  with  particular  emphasis  on  the  pilot’s  overall  workload  for  mission 
performance. 


INTRODUCTION 

This  paper  summarizes  the  methodology  recently  employed  to  assess  systems  Integra¬ 
tion  and  pilot  workload  during  flight  tests  at  Edwards  Air  Force  Base,  California.  The 
tests  involved  the  integration  of  the  pilot  with  the  Low  Altitude  Navigation  and  Targeting 
Infrared  System  for  Night  (LANTIRN)  and  the  f-16  fighter  aircraft  manufactured  by  General 
Dynamics.  The  test  aircraft  were  two  F-16B  aircraft  and  one  F-16A  modified  with  F-16C/D 
avionics  systems. 

The  LANTIRN  System  is  a  revolut ionary  new  system  that  consists  of  a  Navigation  Pod 
( NVP ) ,  a  Targeting  Pod  ( TGP )  and  a  Wide-Angle  Raster  (WAR)  holographic  Head-up  Display 
(HUD).  This  system  was  designed  to  provide  pilots  with  the  ability  to  navigate  at  low 
altitude  and  manually  follow  and  avoid  terrain  while  operating  under  (and  to  a  limited 
extent  through)  the  weather,  both  day  and  night.  LANTIRN  literally  "opened  up  the  night 
window"  for  realistic  tactical  warfare.  As  a  result,  it  was  Tactical  Air  Command's 
highest  priority  test  program  at  the  time  of  this  test.  Additionally,  the  system  was 
designed  to  facilitate  pilots'  abilities  to  find  and  attack  a  variety  of  interdiction  and 
tactical  targets  using  conventional,  self-designated  laser  guided  and  stand-off,  Launch, 
and  forget  weapons  in  a  single-seat  aircraft. 

The  NVP  included  a  Forward-Looking  Infrared  (FLIR)  system  composed  of  a  Fixed- Imag ing 
Navigation  Sensor  (FINS)  and  a  Terrain-Following  Radar  ( TFR) .  Together,  these  provided  a 
day  or  night,  under-the-weather ,  low  altitude  terrain  following  (TF)  capability.  The 
pilot  interfaced  with  this  pod  through  the  WAR  HUD  and  controlled  pod  functions  from  the 
cockpit  via  the  multifunction  displays  ( MFDs )  and  the  up  front  controls  (UFC).  The  TGP 
included  a  target  acquisition  FLIR  (TAF),  an  image  tracker,  a  stabilization  system,  a 
Missile  Boresight  Correlator  (MBC),  and  a  Laser  Designator/Ranger  ( LDR ) .  These  al  lower) 
a  day  or  night,  under-the-weather  target  acquisition  and  recognition  and  first  pass 
weapons  delivery  capability.  Pilots  interfaced  with  this  pod  through  the  MFDs  and  the 
hands-on  controls  on  the  side  stick  controller  and  throttle  grip. 

The  specific  objectives  of  this  test  were  categorized  into  four  main  areas  of  con¬ 
cern.  The  first  was  to  assess  operability  and  controllability  of  the  F-16/LANTIRN  System 
integration  mechanization,  insuring  that  the  controls  and  displays  permitted  proper 
operation,  efficient  and  effective  control,  and  provided  sufficient  feedback  to  the 
operator/pilot.  The  second  was  to  assess  pilot  workload,  verifying  that  the  pilot  could 
accomplish  all  navigation,  TF,  threat  response,  target  acquisition,  and  weapons  delivery 
tasks  without  undue  workload. 


The  major  thrust  of  this  phase  of  Development  Test  and  Evaluation  (DT&E)  testing  for 
LANTIRN  was  to  assess  the  overall  impact  of  the  TGP  to  the  LANTIRN  mission.  The  third 
objective  was  to  assess  the  overall  contribution  of  the  LANTIRN  TCP  to  the  low  level 
navigation  task.  (The  TGP  was  not  specifically  designed  to  provide  low  level  navigation 
capabilities.  That  was  the  intent  of  the  NVP.  The  TGP  was  expected,  nonetheless,  to 
enhance  low  level  navigation,  and  the  extent  to  which  it  did  was  the  intent  of  the  third 
objective.)  The  fourth  area  of  concern  was  to  verify  that  the  LANTIRN  Eire  Control 
System  (PCS)  and  F-16  test  aircraft  were  adequately  integrated  to  provide  the  pilot  a  day 
or  night,  under-the-weather  capability  to  detect  and  recognize  targets,  permitting 
successful  weapons  deliveries  on  the  first  pass  at  the  target.  It  was  determined  during 
the  planning  phase  of  testing  that,  to  a  large  degree,  all  these  objectives  could  be 
achieved  within  a  comprehensive  workload  evaluation  that  employed  the  various  aircraft 
subsystems  associated  with  the  F-16/LANTIRN  mission. 

The  objectives  were  satisfied  with  a  flight  test  program  that  consisted  of  56 
nighttime,  low  level  sorties  conducted  in  a  simulated  operational  environment  (unfamiliar 
terrain,  unfamiliar  targets,  etc.)  un^r  simulated  operational  conditions  (mission  plan¬ 
ning  folders,  simulated  attacks,  etc.).  Due  to  the  complexity  of  the  avionics  suite  which 
comprised  the  F-16/LANTIRN  System,  the  task  of  flying  these  sorties  under  these  conditions 
was  difficult  and  often  hazardous.  As  a  result,  the  test  methodology  that  was  used  success¬ 
fully  to  satisfy  these  objectives  had  to  be,  and  was,  as  unobtrusive  as  possible. 

OVERALL  TEST  METHODOLOGY 

The  testing  was  conducted  and  data  were  collected  during  three  distinct  phases; 
training.  Systems  Integration  (SI),  and  specialized  demonstrations.  The  test  method 
employed  during  the  training  phase  was  very  similar  to  what  was  used  in  the  SI  phase. 
The  bulk  of  this  testing  centered  on  the  SI  phase,  therefore,  our  discussion  will  concen¬ 
trate  on  this  phase  of  testing.  In  general,  the  demonstrations  were  based  upon  another 
set  of  objectives  and  have  been  excluded  from  the  remainder  of  this  discussion,  with  the 
exception  of  one  demonstration.  This  demonstration  was  the  verification  of  F-16 /LANTIRN 
System  single-seat  effectiveness.  This  was  a  special  phase  of  testing  wherein  the  pilots 
did,  in  fact,  fly  the  P-16/LANTIRN  mission  single  seat.  This  demonstration  followed  the 
SI  phase  and,  in  terms  of  the  assessment  of  systems  integration  and  pilot  workload,  was 
conducted  exactly  like  the  preceeding  SI  phase.  Therefore,  once  again,  the  bulk  of  this 
treatise  will  be  a  discussion  of  the  method  used  during  the  SI  phase. 

Five  experienced  test  pilots  participated  in  the  data  collection  aspects  of  the 
training  and  SI  phase  of  testing  as  well  as  the  single-seat  effectiveness  demonstration. 
They  were  from  a  variety  of  backgrounds  and  their  actual  flight  time  in  an  F-16C/D 
aircraft  varied  from  86  to  380  hours.  The  following  table  presents  the  test  subjects' 
overall  flight  experience. 

LANTIRN  PILOT  FLIGHT  EXPERIENCE 


F 

-16C/D 

Hours 

Total 

F-16 

Hours 

Total 

FTR/TNR 

Hours 

Total 

Hours 

Other 

Aircraft  Flown 

Pilot  A 

(AFOTEC) 

86 

1162.1 

1648.4 

2760.7 

F-4, 

T-38 

Pilot  B 
(TAC) 

380 

956.5 

1895.4 

2164.1 

F-4, 

T-38 

Pilot  C 
(AFSC) 

359 

1497.7 

4408.7 

4986.2 

F-4 , 
T-38, 

RF-4 ,  f-33 , 

F-102,  F- 104 

Pilot  D 

F-4, 

F  - 1 5 , 

(AFSC) 

371 

469.3 

2634.7 

3024.1 

T- 

38 

Pilot  E 
(AFSC) 

170 

782.4 

2077.5 

2346.1 

F-4, 

AT-38B 

NOTE:  Fighter/Training  (FTR/TNR),  Air  Force  Operational  Test  and  Evaluation  Command 
(AFOTEC),  Tactical  Air  Command  (TAC),  and  Air  Force  Systems  Command  (AFSC). 

The  training  phase  consisted  of  sorties  which  were  conducted  to  increase  pilot 
proficiency  with  the  system  as  well  as  to  facilitate  pilot  familiarity  with  the  data 
collection  procedures  prior  to  the  SI  phase.  As  mentioned  previously,  the  SI  phase  was 
the  most  critical  phase  in  terms  of  data  collection.  However,  the  training  phase  was 
crucial  to  the  overall  successful  collection  of  subjective  data  during  the  SI  phase  as  it 
provided  the  invaluable  opportunity  to  train  pilots  as  psychophysical  observers.  The 
training  sorties  were  a  combination  of  low  level  navigation  and  weapons  delivery  maneuvers 
exercising  all  NVP  and  TGP  functions  to  be  tested  during  the  SI  phase.  These  sorties 
were  flown  in  the  Edwards  AFB  complex,  with  attacks  on  familiar  targets,  so  that  emphasis 
could  be  placed  on  achieving  proficiency  with  the  F-16/LANTIRN  System  as  well  as  with  the 
subjective  test  method. 

The  SI  phase  consisted  of  six  different  mission  scenarios  that  were  flown  low  level 
at  night,  terminating  in  one  of  three  different  types  of  simulated  weapons  deliveries, 
with  three  attacks  per  scenario.  These  scenarios  were  initially  flown  in  two-place  F-16B 
aircraft  with  two  LANTIRN -qua li f ied  pilots.  The  rear  cockpit  pilot  functioned  as  a 
safety  pilot  and  was  familiar  with  the  route  flown  and  the  targets  being  attacked.  In 
general,  the  rear  cockpit  pilot  was  not  permitted  to  prompt  the  front  seat  pilot  unless  a 
safety  of  flight  event  were  to  occur.  He  did,  on  occasion,  assist  the  front  seat  pilot 
with  the  subjective  portion  of  the  test. 


The  front  seat  pilot  saw  both  the  actual  route  and  targets  for  the  first  time  during 
SI.  One  of  the  constraints  of  this  test  was  that  these  simulated  operational  mission  scenar¬ 
ios  would  have  to  be  flown,  to  a  large  extent,  over  terrain  and  against  targets  that  might 
be  familiar  to  the  pilots.  However,  the  particular  routes,  comprised  of  specific  low  level 
navigation  legs  with  specified  target  assignments  and  target  headings,  were  new  to  the 
pilots.  Planning  for  each  mission  was  confined  to  the  day  of  the  sortie  (all  sorties  were 
flown  at  night).  It  began  several  hours  before  "step  time"  when  the  pilot  received  his 
"intelligence  data"  (which  was  a  mission  folder  containing  route  information,  weapons  data, 
specific  rules  of  engagement,  pictures,  infrared  (IR)  film  clips,  detail  maps,  etc.)  giving 
him  what  was  thought  to  be  operationally  representative,  detailed  information  relative  to 
the  test  sortie.  After  the  mission  was  planned,  it  was  flown  and  completely  debriefed. 

Performance  Measurement 

Simulated  attack  performance  was  evaluated  immediately  following  an  attack  by  the 
pilot.  The  parameters  used  to  make  the  assessment  had  been  defined  prior  to  the  start  of 
the  test  and  were  specific  to  the  type  of  weapons  delivery.  Accuracy  of  the  real-time 
assessments  was  not  always  constant.  On  numerous  occasions  following  the  mission,  during 
the  video  tape  review,  the  initial  assessments  were  revised  to  comply  more  exactly  with 
the  defined  parameters. 

SUBJECTIVE  TEST  METHODOLOGY 

The  operability  and  controllability  evaluation  was  conducted  primarily  in  conjunction 
with  the  training  and  SI  phases.  Two  subjective  forms  were  used  to  document  pilot 
comments  and  opinions.  To  obtain  pretest  or  baseline  information,  an  operability  and 
controllability  form  was  administered  to  the  pilots  prior  to  SI  testing.  This  form 
solicited  their  impressions  of  the  integration  of  the  two  systems  (LANTIRN  and  F-16)  as 
they  knew  it  from  their  training  phase  of  flight,  as  well  as  from  their  flying  during 
earlier  developmental  testing  of  the  F- 16 /LANTIRN  System.  At  the  termination  of  the  SI 
sorties,  pilots  completed  the  operability  and  control  Labi 1 i ty  form  again.  The  two  sets 
of  responses  were  compared  and  analyzed.  This  particular  test  procedure  yielded  informa¬ 
tion  pertinent  to  all  objectives  associated  with  the  test  effort.  Results  from  these 
forms  indicated  specific  areas  where  there  were  still  significant  mechanization  issues 
which  needed  to  be  addressed  within  the  existing  deficiency  reporting  system. 

The  workload  evaluation  was  accomplished  during  the  SI  phase.  There  exists  a 
plethora  of  definitions  on  workload  in  the  literature.  However,  it  appears  that  most  of 
these  definitions  can  be  placed  into  one  of  three  broad  conceptual  groups:  those  related 
to  the  demands  of  the  flight  tasks  —  input  load,  those  associated  with  the  response  to 
those  demands — operator  effort,  and  interpretations  of  workload  based  on  work  results  or 
performance  (Reference  1).  For  this  test,  workload  was  viewed  as  a  multidimensional 
construct  which  was  a  mixture  of  each  of  these  interrelated  conceptual  groups. 

It  was  well  known  from  earlier  developmental  testing,  as  well  as  from  the  training 
phase,  that  the  complexity  of  the  F- 16 /LAHTI RM  System  had  elevated  the  pilot's  role 
primarily  to  that  of  a  systems  manager,  wherein  the  pilot  must  allocate  his  workload  to 
monitor  four  displays,  evaluate  threats,  terrain  follow  and  terrain  avoid,  select  weapons, 
employ  electronic  countermeasures  (ECM),  etc.,  and  fly  the  aircraft.  This  task  complexity 
suggested  that  perhaps  the  most  important  criterion  for  selecting  a  metric  for  this  test 
would  be  intrusiveness.  This  fact,  along  with  the  basic  complexity  of  the  workload 
concept,  suggested  a  global  indicator  of  workload  (i.e.,  subjective  indication  of  overall 
workload)  would  be  the  most  appropriate  analysis  technique.  One  global  workload  assess¬ 
ment  technique  that  is  capable  of  u^tisfying  all  selection  criteria  requirements  (i.e., 
sensitivity,  diagnostic ity ,  intrusiveness,  validity),  plus  possess  universal  accept¬ 
ability,  does  not  exist.  We  decided  that  a  comprehensive  approach  to  workload  assessment 
would  result  if  two  subjective  techniques  were  employed.  Both  metrics  would  be  supported 
and  validated  to  a  large  extent  by  the  structured  interviews  and  ancillary  subjective 
narrative  to  be  elicited  from  the  pilots.  The  plan  was  to  develop  a  modified 
Cooper-Harper-type  scale  specifically  for  F-16/LANT IRN  SI  testing  applications.  This 
scale  would  be  used  in  conjunction  with  a  subjective  procedure  known  as  Subjective  Work¬ 
load  Assessment  Technique  (SWAT). 

The  workload  scale  developed  for  LANTIRN  SI  was  patterned  after  the  well-known 
Cooper-Harper  handLing  qualities  rating  scale  (Reference  2).  The  Cooper-Harper  Scale 
(CHS)  has  been  used  so  extensively  for  assessing  handling  qualities  that  it  has  become  a 
standard  in  the  flight  test  community.  The  CHS  is  a  global  rating  technique  that  combines 
a  binary  decision  tree  with  a  10-point  scale.  In  spite  of  the  fact  one  half  of  the 
words  on  the  CHS  are  workload  related,  research  indicated  that  the  scale  is  best  suited 
(i.e.,  more  sensitive)  to  tasks  that  are  predominately  motor  or  psychomotor  in  nature 
(Reference  3).  This  was  by  design  because  the  CHS  was  originally  conceived  to  assess 
pilot  motor  or  psychomotor  activities  required  in  the  piloting  of  an  aircraft.  However, 
with  an  integrated  aircra f t /avion i cs  system  as  complex  as  F-16/LANTIRN,  pilots  rely  on 
cognitive  abilities  (perception,  communication,  monitoring,  evaluation,  problem  solving, 
etc.)  to  a  greater  extent  than  on  motor  or  psychomotor  skills. 

The  original  CHS  has  been  modified  by  many  experimenters  (Reference  3).  In  these 
instances,  the  modifications  to  the  original  CHS  did  not  incorporate  a  major  change  to 
the  overall  emphasis.  However,  beginning  in  1981  and  continuing  through  1983,  the 
researchers,  Casali  and  Wierwille,  with  the  intent  of  creating  a  scale  that  could  be  used 
specifically  for  assessing  workload,  developed  and  tested  a  modified  version  of  the  origi¬ 
nal  CHS  that  stressed  the  more  cognitive  aspects  of  task  accomplishment  (Reference  3). 
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The  studies  performed  by  Casali  and  Wierwille  demonstrated  that  certain  mod ificat ions 
could  be  made  to  the  original  CHS  with  the  modified  scale  retaining  the  sensitivity# 
reliability  and  validity  of  the  original  scale.  The  modifications  involved  the  wording 
within  the  scale,  aligning  it  with  the  cognitive  aspects  of  workload.  As  a  result  of 
their  research,  they  produced  a  statistically  reliable  scale  that  could  be  used  as  an 
overall  indicator  of  mental  workload.  They  called  their  scale  a  Modified  Cooper-Harper 
Scale  (flCH)  (figure  1). 

A  scale  similar  to  the  CHS  or  the  Casali  and  Wierwille  MCH  was  determined  to  be  the 
most  appropriate  choice  for  one  of  two  subjective  opinion  measures  for  SI  testing  for  a 
variety  of  reasons.  One  justification  was  that  the  test  pilot  community  is  very  familiar 
with  the  original  CHS.  It  is  well  known  that  people  tend  to  ascribe  legitimacy  to  tech¬ 
niques  that  are  familiar  to  them.  As  a  result,  a  priori  acceptance  of  a  scale  that 
resembled  the  original  Cooper-Harper  was  expected  and  received.  Test  subject  acceptance 
of  test  methods  is  one  of  the  most  important  elements  in  subjective  evaluations. 

The  Casali  and  Wierwille  MCH  scale  was  not  considered  appropriate  for  direct 
application  to  SI  testing  without  mod i f icat ions .  Their  MCH  scale  did  not  incorporate 
performance  criteria  associated  with  various  levels  of  workload.  We  needed  a  measure  that 
integrated  perceived  workload  and  perceived  performance.  We  assumed  that  minor  modifica¬ 
tions  to  their  MCH  scale  could  be  made  without  significantly  altering  the  validity  of  the 
scale.  The  format,  and  ir,  particular,  the  inclusion  of  a  binary  decision  tree,  were 
thought  to  be  the  most  important  attributes  that  should  be  retained  in  the  development  of 
a  LANTIRN  workload/per form3nce  assessment  MCH  scale. 

Our  goal  was  to  design  a  scale  that  (l)  closely  resemhled  the  format  of  the  original 
CHS  as  well  as  the  Casali  and  Wierwille  MCH  scale,  (2)  integrated  perceived  workload 
associated  with  perceived  attack  performance ,( 3 )  involved  some  measure  of  F-16 /LANT  LRN 
System  integration,  and  (4)  was  succinctly  worded  to  fit  on  a  standard  5-inch  by  8-inch 
flight  card. 

The  LANT  I RN-speci f ic  MCH  scale  that  was  finally  developed  was  called  the  LANTERN 
Workload  ScaLe  (LAWS)  (Figure  2).  The  attack  performance  descriptors,  " DES"  for  DESIRED, 
" ADQ"  for  ADEQUATE,  and  "INADQ"  for  INADEQUATE,  were  defined  by  performance  parameters 
relevant  to  three  different  weapons  delivery  categories.  Although  somewhat  artificial, 
as  they  were  not  exactly  representative  of  the  maneuvering  tactics  that  might  have  been 
employed  in  a  true  operational  scenario,  the  parameters  did,  nonetheless,  provide  general 
guidelines  for  standardizing  pilot  performance.  This  permitted  comparisons  between 
individual  pilot  performances  specific  to  the  three  types  of  deliveries. 

For  this  test,  perceived  workload  was  divided  into  three  major  categories  to  indicate 
increasing  levels  of  workload.  Each  workload  category  descriptor  (minimum,  moderate,  and 
extensive)  was  associated  with  a  respective  F-16/LANTIRN  System  characteristic,  attack 
performance  rating  (as  above),  and  LAWS  numerical  rating.  For  example,  the  ''minimum" 
workload  descriptor  was  associated  on  the  scale  with  F-16/LANTIRN  System  characteristics 
like  "good — negligible  deficiencies"  and  "DESIRED"  attack  performance,  with  a  numerical 
rating  of  2;  or  "minor  but  annoying  deficiencies"  and  "ADEQUATE"  attack  percormance,  with 
a  numerical  rating  of  4.  The  LAWS  was  divided  into  thcee  groups  of  three,  with  a  separate 
group  for  major  deficiencies  where  improvement  was  mandatory  (numerical  rating  of  10). 

The  SWAT  procedure  referred  to  earlier  and  incorporated  into  this  test  as  the  second 
subjective  opinion  measure,  was  developed  by  the  Air  Force  Aerospace  Medical  Research 
Laboratory  (AFAMRL).  For  background  development  information  on  SWAT  see  Reference  4. 
SWAT  defines  relative  perceived  workload  in  three  dimensions:  (l)  time  load,  (2)  mental 
effort  load,  and  (3)  psychological  stress  load.  The  following  descriptions  of  each 
dimension  developed  by  AFAMRL  were  given  to  the  test  subjects: 


Time  Load 

Time  load  refers  to  the  fraction  of  the  total  time  that  you  are  busy. 
When  time  load  is  low,  sufficient  time  is  available  to  complete  all  of  your 
mental  work  with  some  time  to  spare.  As  time  load  increases,  spare  time  drops 
out  and  some  aspects  of  performance  overlap  and  interrupt  one  another.  This 
overlap  and  interruption  can  come  from  performing  more  than  one  task  or  from 
different  aspects  of  performing  the  same  task.  At  higher  levels  of  time  load, 
several  aspects  of  performance  often  occur  simultaneously;  you  are  busy,  and 
interruptions  are  very  frequent. 

Mental  Effort  Load 

As  described  above,  time  load  refers  to  the  amount  of  time  one  has  avail¬ 
able  to  perform  a  task  or  tasks.  In  contrast,  mental  effort  load  is  an  index 
of  the  amount  of  attention  or  mental  effort  required  by  a  task  regardless  of 
the  number  of  tasks  to  be  performed  or  any  time  limitations.  When  mental 
effort  load  is  low,  the  concentrat  ion  and  attention  required  by  a  task  is 
minimal,  and  performance  is  nearly  automatic.  As  the  demand  for  mental  effort 
increases,  due  to  task  complexity  or  the  amount  of  information  which  must  be’ 
dealt  with  in  order  to  perform  adequately,  the  degree  of  concentration  and 
attention  required  increases.  High  mental  effort  load  demands  total  attention 
or  concentration  due  to  task  complexity  or  the  amount  of  information  that  must 
be  processed . 


Psychological  Stress  Load 

Stress  load  refers  to  the  contribution  to  total  workload  of  any  conditions 
that  produce  anxiety,  frustration,  or  confusion  while  performing  a  task  or 
tasks.  At  low  levels  of  stress,  one  feels  relatively  relaxed.  As  stress  in¬ 
creases,  confusion,  anxiety,  or  frustration  increase  and  greater  concentration 
and  determination  are  required  to  maintain  control  of  the  situation. 

According  to  the  SWAT  procedure,  each  of  these  three  dimensions  was  assigned  three 
levels,  corresponding  roughly  to  high,  medium  and  low  loading.  A  precise  definition  for 
each  level,  as  developed  by  AFAMRL  is  shown  in  Figure  3.  The  SWAT  procedure  started  by 
having  the  test  subjects  perform  what  is  called  a  "card  sort".  The  card  deck  consisted 
of  27  cards  with  all  possible  combinations  of  the  three  levels  of  the  three  dimensions  of 
workload.  The  test  subjects  rank  ordered  the  workload  descriptors  according  to  their 
personal  perceptions  of  workload.  The  individual  card  sorts  from  the  test  subjects  were 
combined  through  a  mathematical  procedure  known  as  conjoint  measurement.  Conjoint  measure¬ 
ment  tests  the  ordered  data  to  determine  the  combination  rules  used  by  the  subjects.  An 
additive  model  leads  to  a  combined  workload  score,  incorporat ing  time  load,  mental  effort, 
and  psychological  stress,  on  an  interval  scale  ranging  from  zero  to  100. 

The  SWAT  card  sort  information  obtained  from  each  test  subject  was  analyzed  with  the 
AFAMRL  SWAT  computer  program.  This  program  determined  prototypes  for  the  individual 
subjects.  For  example,  a  subject  that  was  a  "time"  prototype  considered  the  time  load 
dimension  to  contribute  the  heaviest  to  his  perception  of  workload.  There  were  six 
possible  prototype  groups.  The  two  highest  correlation  coefficients  of  the  six  determine 
to  which  group  the  subject  belongs.  Of  the  five  test  subjects  who  participated  in  SI 
testing,  three  were  prototyped  "stress”,  with  "time"  the  second  factor;  and  two  were 
prototyped  “time",  with  "stress"  the  second  factor. 

Group  scaling  was  also  provided  by  the  SWAT  computer  prdgram.  For  group  scaling, 
the  data  from  all  subjects  was  averaged  together  and  conjoint  analysis  derived  a  single 
scale  for  the  group.  To  use  group  scaling,  the  derived  Kendall's  Coefficient  of 
Concordance  had  to  be  greater  than  0.78.  The  SI  test  subjects  had  a  Kendall's  Coefficient 
of  Concordance  of  0.897  which  indicated  a  high  level  of  agreement  among  test  subjects. 
If  the  coefficient  had  been  lower  than  0.78,  either  prototype  or  individual  scaling  would 
have  been  used  for  the  scalinq  in  this  test. 

The  combined  values  were  broken  down  at  the  end  of  the  SL  testing  phase  into  five 
categories  representing  various  levels  of  workload  (Table  1). 

Table  I 

SWAT  DESCRIPTIVE  LEVELS  OF  WORKLOAD 


SWAT 

SCORE 

WORKLOAD  LEVEL 

0.00 

-  15.99 

Minimum 

16.00 

-  29.99 

Moderately  Low 

30.00 

-  55.99 

Moderate 

56.00 

-  69.99 

Moderately  High 

70.00 

-  100.00 

Extensive 

The  combined  SWAT  scores  wore  not  normally  distributed.  Ry  selecting  the  categories 
shown  in  Table  l,  an  approximate  normal  distribution  of  the  data  set  was  achieved.  The  lack 
of  normality  for  the  combined  SWAT  data  was  probably  an  effect  of  sample  size  or  selection. 

The  two  subjective  metrics  employed  during  this  test  were  LAWS  and  SWAT.  Immediately 
following  an  attack,  the  test  subject/pilot  rated  the  attack  sequence  using  these  two  met¬ 
rics.  Therefore,  pilot  workload  was  evaluated  per  attack  sequence,  including  ingress  and 
egress.  In  addition,  to  gain  some  workload  information  relative  to  the  low  level  portions 
of  the  flight,  the  subjects  rated  these  segments  using  the  SWAT  technique.  As  LAWS  was 
attack  specific,  it  was  not  used  to  evaluate  the  low  level  navigation  portions  of  the  test. 

The  six  routes  used  during  the  SI  phase  were  designed  to  test  the  navigation  capability 
of  the  F-16/LANTIRN  System  over  various  types  of  terrain  and  targeting/attack  capability 
against  targets  of  several  thermal  contrasts.  Terrain  varied  from  the  flat,  dry  lakes  of 
the  Mojave  Desert  to  the  rolling  hills  of  the  central  California  coast  and  rugged  mountains 
of  the  Sierra  Nevada.  Weather  conditions  also  varied  from  the  clear,  low  humidity  condi¬ 
tions  found  in  the  desert,  to  low  overcast,  high  humidity  conditions  found  along  the 
central  California  coast. 

Each  profile  required  that  the  pilot  navigate  past  three  turnpoints  prior  to  reaching 
a  simulated  target.  Three  targets  were  included  on  all  routes.  Although  in  a  true  opera¬ 
tional  scenario  there  is  generally  no  more  than  one  target/attack  sequence  per  route,  we 
included  three  separate  target /attack  combinations  to  maximize  data  acquisition.  More 
than  three  targets  would  have  drained  the  pilots*  mental  and  physical  reserves  and  would 
have  confounded  the  test  results,  in  particular  the  workload  results. 

Pilots  were  asked  to  evaluate  the  F-16/LANTIRN  System  performance  and  its  contri¬ 
bution  to  pilot  workload  for  each  attack  sequence  using  the  LAWS  and  SWAT.  To  facilitate 
data  collection,  most  routes  were  designed  with  an  orbit  following  the  attacks.  The  orbit 
gave  the  pilots  an  opportunity  to  pop  up  out  of  the  low  altitude  environment  so  that  they 
could  provide  the  necessary  workload  information  without  impacting  the  workload  associated 
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with  setting  up  for  the  next  turnpoint  or  attack.  In  addition  to  rating  the  attacks,  pilots 
were  requested  to  comment  as  often  as  they  could  "real  time"  (their  comments  were  recorded 
by  the  onboard  video  recording  system)  on  the  operability  and  controllabi 1 i ty  of  the 
LANTIRN  system,  and  on  F-16/LANTIRN  System  capabilities,  deficiencies,  and  workload. 

A  flight  card  containing  the  abbreviated  LAWS  narrative  and  a  SWAT  mnemonic  was 
designed  to  allow  quick  interpretation  and  use  by  the  pilots  in  the  flight  environment. 
Approximately  10  variations  of  a  flight  card  were  flight  tested  during  the  training  phase 
of  SI.  Finally,  an  acceptable  flight  card  was  created  that  contained  the  most  salient 
workload  related  words  with  associated  attack  performance  and  SWAT  information  (Figure  4). 
To  rate  the  attacks,  pilots  would  "step"  through  the  flight  card  beginning  with  the  boxed 
question  in  the  upper  left-hand  corner.  For  the  SWAT  score  the  pilots  could  use  the  SWAT 
mnemonic  provided,  or,  if  they  preferred,  the  rear  cockpit  safety  pilot  could  read  them 
the  full  SWAT  descriptors  that  were  listed  on  the  reverse  of  the  flight  card  (Figure  3). 

The  pilots  were  very  conscientious  about  giving  accurate  scores  using  both  metrics. 
With  very  few  exceptions,  they  were  able  to  "walk  through"  the  binary  decision  tree 
associated  with  the  LAWS  and  arrive  at  a  LAWS  rating  that  unambiguously  reflected  the 
perceived  workload  required  to  achieve  a  certain  attack  performance.  To  a  large  extent  the 
acceptance  of  the  method  was  a  result  of  their  total  familiarity  with  the  procedures  and 
the  subjective  metrics  that  they  were  exposed  to  during  the  training  phase  of  testing. 

On  a  couple  of  occasions,  a  situation  occurred  wherein  the  pilot  would  report  a 
performance  rating  of  "INADEQUATE"  which  he  attributed  primarily  to  pilot  error.  The 
error  was  in  attacking  the  wrong  target.  There  were  no  LANTIRN  System  malfunctions, 
aircraft  integration  problems,  or  workload  issues.  Often,  during  the  extensive  postflight 
video  tape  review,  the  error  could  be  shown  to  be  attributable  to  excessive  workload 
before  the  target  acquisition  phase,  to  the  less  than  optimum  (small)  display  size  for 
TGP  FLIR,  to  INS  drift,  or  to  a  deficiency  in  mission  planning  by  the  pilot.  The  LAWS 
did  not  provide  for  these  anomalies.  This  type  of  situation  occurred  very  infrequently. 
Consequently,  it  was  decided  this  anomaly  did  not  invalidate  the  general  use  of  the  LAWS. 
In  addition,  these  anomalies  had  little  effect  on  the  overall  workload  test  resuLts. 

Subsequent  to  each  flight  a  debriefing  was  held  to  evaluate  the  overall  effectiveness 
of  the  mission.  A  review  of  the  recorded  video,  with  particular  emphasis  on  the  attack 
sequences,  occurred  afterwards.  During  these  sessions,  test  subject /pi lots  participated 
in  a  structured  interview. 

At  the  completion  of  all  testing,  overall  mission  effectiveness  was  defined  as  the 
total  of  all  DESIRED  and  ADEQUATE  attack  performances. 

DISCUSSION 

As  a  result  of  using  the  two  subjective  metrics,  supplemented  by  pilot  narrative,  a 
global  view  of  F-16/LANTIRN  System  integration  and  workload  was  achieved.  In  addition, 
we  were  able,  as  a  function  of  the  LAWS  metric,  to  compare  and  contrast  attack  performance 
for  the  three  types  of  weapons  deliveries  and  derive  an  overall  effectiveness  rate.  All 
actual  test  results  were  classified.  Therefore,  the  "results"  contained  within  this 
section  are  listed  generically  and  may  only  be  interpreted  as  general  representations  of 
the  data  we  received  as  a  result  of  this  test  methodology. 

A  summary  of  workload  ratings  for  the  three  weapons  delivery  types  was  derived  from 
the  LAWS  metric  (Table  2)  and  from  the  SWAT  (Table  3). 

TABLE  2 


LANTIRN  WORKLOAD  SCALE  (LAWS)  SUMMARY  FOR 
INTEGRATION  WEAPONS  DELIVERY  TYPES 

SYSTEMS 

Weapons 

Numbers 

of  LAWS  Ratings 

Delivery 

Types 

Minimum 

Moderate 

Extensive 

A 

~ n 

9 

5 

B 

3 

17 

9 

C 

? 

T9 

~i 

TOTAL 

23 

45 

16 

NOTE:  The  totals  for  each  weapons  delivery  type,  across  LAWS  and  SWAT  ratings,  do  vary. 
Some  test  sorties  were  deemed  ineffective  due  to  extenuating  circumstances,  like  weather 
or  aircraft  subsystem  failures. 

TABLE  3 


SUBJECTIVE  WORKLOAD  ASSESSMENT  TECHNIQUE  (SWAT)  SUMMARY  FOR  SYSTEMS 
_  INTEGRATION  WEAPONS  DELIVERY  TYPES 


Weapons 

Delivery 

Types 

Numbers  of  SWAT  Ratings 

Minimum 

Mod 

Low 

Moderate 

Mod 

High 

Extensive 

A 

5 

7 

8 

2 

3 

B 

5 

4 

6 

3 

11 

e 

re 

2 

5 

4 

6 

TOTAL 

20 

13 

22 

9 

20 

The  data  in  Table  2  suggested  a  global  workload  assessment  of  "moderate"  for  these 
three  weapons  delivery  types.  This  statement  was  corroborated  by  the  SWAT  results 
presented  in  Table  3.  However,  note  the  number  of  "extensive"  responses  on  both  tables. 
In  all  cases  (Tables  2  and  3),  these  "extensive"  ratings  suggested  the  occurrence  or  near 
occurrence  of  "overload"  situations.  "Overload"  situations  are  those  subjective  experiences 
in  which  the  entire  complement  of  elements  that  comprise  workload  for  any  given  event 
results,  generally,  in  degradation  of  performance.  Overload  may  occur  at  different 
levels  for  different  individuals.  “Extensive"  ratings  also  suggested  that  little  workload 
reserve  capacity  existed  for  other  unplanned  elements  of  a  complex  task. 

As  mentioned  earlier,  both  metrics  were  compared  to  a  large  volume  of  narrative 
information  obtained  from  the  pilots  both  during  and  after  flight.  The  primary  reason 
for  measuring  workload  was  to  identify  conditions  under  which  attack  performance  could  be 
expected  to  deteriorate.  As  a  result  of  this  methodology,  we  were  able  to  determine  and 
report  on  the  extenuating  factors  that  either  did,  or  could  realistically  be  expected 
to,  contribute  to  the  "extensive"  ratings  and  subsequently  impact  overall  workload  and 
performance.  The  factors  thus  identified  varied  tremendously  between  what  could  be 
controlled  (e.g.,  mission  planning,  known  deficiencies  or  limitations  of  the  test, 
tactics)  and  those  factors  which  could  not  be  controlled  (e.g.,  a  shift  in  pilot  priori¬ 
ties,  humidity,  weather,  target  characteristics  that  were  less  than  optimum,  system 
anomalies  that  interfered  with  or  caused  the  pilots  to  have  to  compensate  in  order  to 
execute  the  attack  precisely,  etc.).  In  addition,  two  other  factors  that  may  have  impacted 
workload  and  performance  were  not  controlled  in  this  test:  work  durations  and  proficiency 
levels. 

When  we  isolated  the  three  possible  workload  categories  from  the  LAWS  scores 
(minimum,  moderate,  and  extensive)  and  plotted  them  with  the  SWAT  combined  workload 
ratings,  the  data  showed  a  positive  relationship  between  the  two  workload  techniques. 
When  we  plotted  LAWS  combined  workload  and  performance  scores  (numbers  1  through  10)  with 
the  SWAT  combined  workload  ratings,  the  data  tended  to  show  a  positive  correlation  and 
were  somewhat  homoscedast ic  (Figure  S).  This  correlation  is  not  conclusive. 

In  general,  despite  the  extensive  training,  and  to  a  certain  extent,  terrain  and 
target  familiarity,  the  workload  responses,  from  both  techniques,  were  distributed 
throughout  the  range  of  workload  possibilities,  across  weapons  delivery  types,  and  were 
not  always  dependent  upon  level  of  performance.  This  was  probably  due  to  the  same 
combination  of  effects  or  extenuating  factors,  as  mentioned  above. 

For  the  low  level  navigation  assessments,  we  relied  primarily  on  subjective  narrative 
elicited  by  structured  interviews.  This  procedure  revealed  that,  in  general,  the  TGF 
served  to  increase  overall  pilot  situational  awareness.  In  addition,  the  pilots  evaluated 
a  limited  number  of  specific  navigational  segments  using  SWAT.  These  results  yielded 
important  relative  workload  information  and  enabled  us  to  make  definitive  statements 
regarding  the  overall  contribution  of  the  Targeting  Pod  to  the  low  level  navigation 
portion  of  the  F-16/LANTIRN  mission. 

CONCLUSION 

The  general  conclusion  from  this  effort  was  that  it  was  impossible  t^  predict 
potential  workload  from  observing  performance.  This  is  consistent  with  other  reports 
(Reference  5).  However,  due  to  the  test  methodology  just  described,  it  was  possible  to 
identify  those  factors  which  degraded  performance,  or  forced  the  requirement  for  excessive 
pilot  compensation  with  a  concomitant  increase  in  pilot  workload. 
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SUMMARY 

Workload  research  has  led  In  the  past  to  the  development  of  various  measures,  mostly  concerning 
different  aspects  of  task  workload,  in  a  separate  and  isolated  way.  In  addition,  present  opinion  assumes 
more  and  more  that,  in  order  to  achieve  a  satisfactory  workload  evaluation,  a  matrix  of  measures  is 
needed. 

This  paper  discusses  a  number  of  considerations  concerning  the  problem  of  being  able  to  draw  conclusions 
from  a  variety  (i.e.  a  matrix)  of  experimental  measures  in  a  complex  task  situation.  Several  Implications 
are  pointed  out,  such  as  the  problem  of  dealing  with  contradictory  outcomes,  the  designating  oi  artefacts, 
and  the  problem  of  formulating  final  conculsions  without  the  (a-priori)  availability  of  a  superior  method 
for  evaluating  ocher  methods. 

These  considerations  have  been  examined  in  detail  in  an  in-flight  study  concerning  the  assessment  of  pilot 
workload  under  various  instrument  approach  conditions  for  a  fixed-wing  (civil)  transport  aircraft.  The 
experimental  findings  have  been  compared  with  the  results  of  a  former  in-flight  experiment  dealing  with 
pilot  workload  and  performance  during  helicopter  (instrument-flying)  tasks. 

A  discussion  is  given  of  the  results  consisting  of  subjective  ratings,  physiological  measures,  and  task 
performance  measures.  A  strategy  is  discussed,  dealing  with  the  formulation  of  final  conclusions  based  on 
the  outcomes  of  a  matrix  of  measures. 


ABBREVIATIONS 

ABP 

Average  band  power 

ACL 

Above  ground  level 

AP 

Autopilot 

AT  PL 

Airline  transport  pilot  licence 

b.p.m. 

Beats  per  minute 

CPL 

Commercial  pilot  licence 

dB 

Decibel 

DME 

Distance  measuring  equipment 

e 

Error  (or:  residual)  variation 

FD 

Flight  director 

G 

Groningen  airport 

IF 

instrument-flying 

ILS 

Instrument  landing  system 

KT 

Knot (s) 

M 

Mean 

KDB 

Non  directional  beacon 

NLR 

National  Aerospace  Laboratory 

P 

Pilot 

R 

Rotterdam  airport 

RMS 

Root  mean  square 

RMSSD 

Root  mean  square  of  successive  differences 

SD 

Standard  deviation 

SYNC 

Synchronizer 

T/L 

Take-off  and  landing 

VHF 

Very  high  frequency 

VOR 

VHF  omnidirectional  range 

VTHR 

Threshold  speed 

WL 

Workload 

INTRODUCTION 

During  the  last  two  decades  considerable  research  efforts  have  been  devoted  to  developing  a  proper 
iranework  from  which  pilot  workload  can  be  analysed  in  a  systematic  manner.  In  this  context,  several 
attempts  have  been  made  to  come  to  an  unequivocal  definition  of  the  concept  "workload"  as  well  as  to  find 
an  adequate  method  for  its  "measurement".  At  present  it  must  be  stated,  however,  that  these  efforts  have 
not  yet  produced  a  satisfactory  result.  Although  there  is  general  agreement  among  investigators  about  the 
existence  of  different  measures  which  could  be  used  in  some  way  as  workload  indicators,  there  is  still  no 
agreement  about  which  these  are,  about  which  are  the  most  effective,  or  about  how  (combinations  of)  these 
measures  can  be  related  to  changes  in  the  workload  of  an  operator. 

This  situation  has  resulted  in  the  development  of  a  large  number  of  measures  for  "quantifying"  the 
operator's  workload,  whereas  relatively  little  systematic  research  has  been  devoted  to  basic  aspects,  such 
as  estimating  the  sensitivities  of  specific  measures  with  respect  to  different  task  conditions  and  the 
relative  practical  usefulness  of  different  techniques  within  different  operational  environments. 
Furthermore,  it  has  been  assumed  in  a  growing  number  of  workload  investigations  that  we  are  dealing  with  a 
multidimensional  concept,  hence  a  combination  of  measures  is  needed,  or  alternatively  one  measure  with 
sensitivity  to  several  dimensions,  in  order  to  come  to  a  satisfactory  evaluation  of  the  operator's 
workload.  This  idea  lias  had  little  impact,  however,  on  the  development  and  use  of  workload  measurement 
techniques . 


The  foregoing  outlines  some  reasons  for  developing  a  new  approach  towards  the  study  of  workload 
measurement.  Such  an  approach  should  be  based  upon  the  presumption  that  the  concept  of  workload 
encompasses  various  task-  and  operator-related  aspects,  for  which  each  measure  will  most  likely  have  a 
different  sensitivity.  In  addition,  the  data  obtained  with  these  different  measures  must  be  integrated  in 
a  proper  way  in  order  to  arrive  at  valid  conclusions. 

In  the  following,  the  implications  of  such  an  approach  are  discussed  In  detail  .  The  resulting 
consequences  are  judged  on  their  merits  on  the  basis  of  the  outcomes  of  two  in-flight  workload  studies. 
The  first  study  deals  with  instrument  approaches  carried  out  on  a  (civil)  fixed  wing  aircraft  under  a 
variety  of  approach  conditions.  The  second  study  concerns  helicopter  instrument-flying  tasks,  such  as 
hovering  and  tracking. 

The  considered  workload  measures  include  subjective  ratings,  physiological  measures,  control  activity 
measures,  and  (mathematical)  model  measures.  The  pertinent  outcomes  are  discussed  in  connection  with  a 
strategy  to  arrive  at  an  overall  conclusion  on  the  basis  of  the  individual  results  of  different  measures. 


BASIC  IDEAS  AND  AIMS 

The  basic  Ideas  and  aims  behind  this  study,  can  be  formulated  more  specifically  as  follows: 

(1)  It  is  assumed  that  workload  generally  encompasses  several  components,  such  as  time  stress,  effort, 
etc.  It  is  not  clear  which  components  play  a  part  in  a  specific  situation,  nor  what  the  impact  is  of 
each  upon  the  overall  perception  workload.  It  is  therefore  advocated  that  attention  be  paid  to  the 
sensitivity  of  specific  workload  measures  to  different  aspects  of  the  task. 

(2)  As  a  further  consequence  of  (I)  it  can  be  stated  that  research  on  workload  measures  should  not  be 
based  upon  any  underlying  assumptions  about  the  existence  of  a  superior  method  which  can  be  used  as  a 
criterion  (e.g.  "task  complexity’1)  for  the  evaluation  of  other  methods.  Any  such  a-priori  selection 
of  task  conditions  according  to  a  particular  criterion,  which  may  emphasize  specific  properties  of  a 
given  task  situation,  could  conceivably  suppress  the  usefulness  of  certain  other  measures,  due  to  an 
insufficient  degree  of  variation  of  other  task  variables  to  which  these  measures  are  specifically 
sensitive.  In  other  words,  any  assumption  which  supposes  that  "degrees"  of  work’oad  can  be  indicated 
on  the  basis  of  one  criterion  exclusively,  is  contradictory  to  the  idea  that  workload  is 
multidimensional.  Investigations  of  workload  measures  should  therefore  not  start  from  an  a-priori 
ranking  of  task  conditions  with  respect  to  the  expected  "amount"  of  workload  involved  in  the  tasks. 
Instead,  the  underlying  rationale  for  drawing  certain  conclusions  should  first  be  considered  care¬ 
fully  . 

(3)  Most  workload  studies  focus  exclusively  on  identifying  differencr  in  workload.  It  is  important, 
however,  that  such  studies  focus  also  on  the  problem  of  indentifying  similar  workload  levels  with 
respect  to  different  tasks.  This  can  have  considerable  consequences  for  the  experimental  design. 
Equivalence  in  workload  level  has,  for  example,  still  not  been  demonstrated  In  cases  where  measured 
differences  do  not  reach  a  significant  level.  It  is  necessary  in  workload  studies,  therefore,  to 
establish  the  power  of  the  intended  statistical  tests  in  an  early  stage  of  the  ..*vestigation.  Only  in 
cases  of  sufficient  power  of  the  statistical  tests  being  used  (larger  than,  say,  0.7)  it  is  possible 
to  identify  -  with  a  reasonable  certainty  -  both  possible  similarities  and  differences  in  workload 
for  different  task  situations. 

(4)  As  a  consequence  of  (3),  minimal  differences  of  interest  ("indifference  margins")  have  to  be 
specified  with  respect  to  each  workload  measure.  The  smaller  these  minimal  differences  are,  the 
larger  the  sample-size  must  be  in  order  to  obtain  the  same  power  of  the  test.  It  is  usually  of  little 
interest,  for  example,  to  detect  "small"  differences  between  two  tasks,  such  as  differences  in 
average  heart  rate  of,  say,  0.1  beat  per  minute,  or  differences  on  a  10-point  rating  (interval-) 
scale  between  values  of,  say,  6.2  and  6.3. 

By  carefully  selecting  plausible  indifference  margins,  it  should  therefore  be  possible  to  use 
workload  measures  as  indicators  of  differences  as  well  as  of  similarities  in  workload  at  an  a-priori 
specified  power.  Clearly,  there  is  a  need  for  a  general  agreement  in  connection  with  the 
specification  of  the  indifference  margins  for  workload  measures. 

(3)  Once  the  data  from  a  specific  measure  have  indicated  that  either  a  (positive  or  negative)  change  or 
an  equivalence  in  workload  has  occurred,  it  is  necessary  to  define  a  strategy  for  drawing  conclusions 
on  the  basis  of  a  number  of  different  modality  measures,  including  some  possibly  contradictory 
results.  Such  a  strategy  should  preferably  be  uncomplicated  in  its  utilization  so  that  the  final 
(overall)  conclusions  will  not  give  rise  to  problems  of  interpretation.  An  obvious  strategy  would  be 
based  upon  the  degree  of  homogeneity  in  the  results.  The  desired  level  of  homogeneity  must  be  stated 
by  convention.  That  is  to  say,  when  using  several  measures  simultaneously,  it  should  be  acceptable  to 
tolerate  a  certain  percentage  of  diverging  results  when  formulating  the  final  conclusion. 
Alternatively,  all  deviating  outcomes  must  be  inspected  on  the  presence  of,  for  instance,  artefacts 
which  could  raise  the  cost  of  an  investigation  considerably.  If  a  critical  amount  of  deviating 
results  is  exceeded  it  is  necessary  to  carry  out  additional  investigations  of  the  considered  cases 
until  the  desired  level  of  homogeneity  in  the  results  has  been  obtained. 

(6)  The  task  situations  to  be  selected  for  workload  experiments  must  correspond  to  the  ultimate  complex 
operational  environment  for  which  the  methods  are  intended  to  be  used.  This  objective  also  supports 
the  need  for  in-flight  research  programs,  to  be  used  as  a  common  basis  for  different  investigators 
for  comparing  and  collating  measures,  evaluating  strategies,  effects  of  task  aspects,  etc.  Such 
programs  can  be  extended  by  including  progressively  more  relevant  task  situations,  ultimately 
arriving  at  a  general  framework  from  which  operationally  oriented  pilot  workload  studies  can 
proceed  systematically  . 


(7)  The  development  of  any  workload  assessment  method  should  have  the  objective  that  the  ultimate 

application  of  the  method  must  not  rely  on  the  availability  of  an  extensively  equipped  research 
aircraft  for  the  necessary  data  recording.  Neither  should  the  data  analysis  and  the  interpretation  of 
the  outcomes  require  the  knowlegde  of  an  expert.  Otherwise,  workload  research  will  possibly  never 
surpass  the  laboratory  environment. 


IN-FLICHT  EXPERIMENTS. 

The  foregoing  considerations  have  led  to  the  development  of  an  in-flight  experimental  program  by 
which  the  feasibility  of  such  an  approach  can  be  inv  stigated.  The  program  deals  with  various  instrument 
approach  conditions  for  a  fixed  wing  transport  aircraft.  Besides,  the  outcomes  of  a  former,  in-flight 
workload  study  concerning  helicopter  instrument-flying  tasks  are  used  as  an  additional  basis  to 
investigate  the  validity  of  the  obtained  results.  Both  experiments  will  subsequently  be  discussed  in  the 
following. 


Experimental  Program 


The  experimental  casks  in  this  experiment  (Ref.  1)  consisted  of  flying  procedural  approaches  (with  an 
external  view  occluding  visor)  with  each  experimental  run  starting  on  "downwind",  approximately  10  minutes 
before  touchdown.  The  independent  task  variables  have  been  based  on  (i)  the  different  approach  aids,  that 
is,  ILS+FD,  1LS,  VOR+DME,  NDB,  (ii)  the  manner  of  pilot  control,  that  is,  automatic,  manual,  or  manual 
with  simulated  trim  malfuntion  (i.e.  retrimming  prohibited  after  downwind),  and  (iii)  the  number  of  crew 
members,  that  is,  2  man  versus  1  man  crew.  The  experimental  conditions  are  presented  in  table  1. 

The  approach  pattern  (for  the  ILS  case)  is  illustrated  in  figure  1.  All  approaches  consisted  of  four 
compatible  segments:  downwind,  turn/intercept ,  1st  segment  final  (above  1000  feet),  2nd  segment  final 
(below  1000  feet),  which  are  very  suitable  for  making  comparisons  between  scenarios  on  the  basis  of  the 
workload  data  obtained.  The  approaches  were  terminated  with  an  overshoot  (at  approximately  50  feet)  to 
increase  the  flexibility  of  the  program.  (Note  that  some  of  the  approaches  must  be  flown  in  opposite 
direction  to  the  rest  of  the  landing  traffic  due  to  local  circumstances  of  wind  and  beacon  locations). 

At  a  suitable  moment  before  the  overshoot  (mostly  just  after  passing  the  middle  marker)  the  subject-pilot 
was  reliefed  from  his  IF-cap  so  that  he  could  fly  the  last  part  visually. 

Subjective  ratings  had  to  be  given  at  the  end  of  each  segment  (resulting  in  4  ratings  per  approach).  The 
ratings  should  concern  the  previously  flown  segment  exclusively.  Ratings  were  obtained  from  both  the 
subject  pilot  and  the  safety  pilot. 

During  the  2-man  crew  task  conditions  the  safety  pilot  had  to  perform  the  duties  of  the  first 
officier;  i.e.:  he  should  take  care  of  ATC  communication,  select  beacons,  set  flaps  on  request,  read  out 
checklists  and  perform  such  other  activities  as  would  be  expected  from  the  first  officer.  In  the  i-man 
crew  task  conditions,  the  subject-pilot  had  to  take  over  these  duties  in  addition  to  the  normal  duties 
required  for  flying  the  aircraft. 

The  considered  workload  measures  in  the  approach  study  are  listed  in  Table  2.  They  cover  a  broad 
range  of  well-known  workload  assessment  techniques.  Besides,  the  selection  of  these  measures  have  also 
partly  been  based  on  ground  of  considerations  regarding  the  practical  implications  of  their  utilization  in 
an  operational  environment. 

The  following  discussions  will  be  restricted  to  the  most  interesting  results.  For  an  extensive  treatment 
of  Che  separate  results  of  all  considered  measures,  the  reader  is  referred  to  reference  1. 

The  experimental  sessions  have  been  carried  out  with  the  NLR  Swearingen  Metro  II  research  aircraft 
(Fig.  2),  which  is  a  twin  engine  turboprop  with  a  gross  weight  of  12,500  lbs.  The  relevant  experimental 
parameters  have  been  recorded  by  means  of  an  aircraft  related  data  acquisition  system  and  an  inertial 
reference  system  or  are  computed  off-line  from  the  recorded  data  (e.g.  wind,  thrust).  The  experimental 
data  are  partly  grouped  over  the  four  segments  (with  exclusion  of  the  rating  parts  at  the  end  of  each 
segment  and  the  'visual*  part  at  the  end  of  the  fourth  segment)  and  subsequently  reduced  to  their  relevant 
statistics.  The  data  from  some  variables  (among  others,  the  flight  path  data)  have  also  been  stored  on  a 
time,  and  distance-to-go  basis. 

Each  experimental  session  contained  the  8  different  approach  conditions,  which  have  been  presented  as 
much  as  possible  in  a  random  order.  The  sessions  have  been  carried  out  at  two  airports  (Rotterdam, 
Groningen^,  and  were  terminated,  each  time  by  means  of  a  full  stop  (single  or  dual  pilot)  ILS  approach  at 
Schiphol  airport;  this  time  without  requesting  ratings  from  the  subject  pilot.  By  this,  eventual  effects 
due  to  the  rating  procedure,  or  the  overshoot  in  stead  of  landing,  could  be  traced  (for  the  ILS  type  of 
approach) . 

The  experimental  program  included  in  total  21  sessions,  which  have  been  carried  nut  by  5  subject-pilots 
and  2  safety  pilots  (CPL  and  ATPL  pilots). 

Rzsul ts 

The  experimental  results  have  been  based  on  analyses  of  variance  upon  the  considered  workload  related 
data  with  respect  to  the  8  experimental  conditions.  Also  analyses  of  covariance  have  been  carried  out  to 
adjust  for  eventual  effects  of  the  uncontrollable  conditions  of  gust,  wind  and  (ATC)  communication  load. 
The  important  experimental  results  can  be  summarized  as  follows: 

First  of  all,  a  further  selection  among  the  workload  measures  had  to  be  made  (in  addition  to  the 
aforementioned  selection  based  upon  considerations  regarding  their  practical  usefulness).  This  time  the 
selection  process  was  necessarily  based  upon  aspects  of  sensitivity  of  the  measures:  a  number  of  measures 
(e.g,  heartrate  variability  and  control  activity  measures)  appear  to  lack  sensitivity  to  task  differences, 
due  to  large  interaction  effects  between  the  factors  subjects  and  tasks,  or  because  of  large  intervening 
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environmental  related  effects  (e.g.  gusdevel).  In  addition  to  this,  a  number  of  measures  is  rather 
restricted  with  respect  to  their  coverage;  for  instance,  primary  task  performance  measures  reflect  also 
Inherent  differences  In  the  approach  accuracy  which  can  obviously  related  to  the  available  approach  aids 
in  the  pertinent  conditions.  Consequently,  it  becomes  a  complicated  manner  to  adjust  the  pertinent  data 
for  these  effects. 

-  Analyses  of  variance  did  not  indicate  any  significant  interaction  effects  between  the  experimental 
conditions  (table  1)  and  the  four  approach  segments  (fig.  I).  For  all  measures,  except  heartrate  measures, 
the  third  segment  results  in  the  best  discrimination  among  the  experimental  task  conditions.  Heart  rate 
measures  are  the  most  discriminative  in  the  fourth  segment,  possibly  due  to  time-lag  effects. 

-  The  utilization  of  different  measures  tends  to  result  -  on  the  average  -  into  similar  workload 
patterns  with  respect  to  the  different  task  conditions.  Measures,  which  are  to  a  less  extent  sensitive  to 
different  task  conditions  show  more  or  less  a  fragmentary  part  of  the  aforementioned  workload  pattern. 
Figures  4  and  5  illustrate  the  workload  patterns  resulting  from  2  measures  of  different  modalities,  namely 
subjective  racings  (McDonnell's  10-point  demand  scale)  and  heart  rate  level.  These  figures  show  that  both 
measures  result  In  rather  similar  outcomes.  Furthermore,  the  sensitivity  of  these  measures  to  the 
different  task  conditions  is  concentrated  within  the  last  two  segments. 

The  figures  also  show  some  specific  aspects:  for  instance,  the  subjective  ratings  for  the  first  segment 
reflect  a  difference  In  workload  between  the  dual  pilot  NDB  conditions  with  and  without  trim  mal  function, 
although  the  difference  in  trimmalfunction  was  not  yet  present  during  this  approach  segment.  Note  that 
this  peculiarity  did  not  occur  in  the  average  heart  rate  measure.  On  the  other  hand,  the  difference 
between  single  pilot  and  dual  pilot  conditions  are  for  both  measures  more  appearent  during  the  first 
segment (s)  than  during  the  third  segment,  although  the  third  segment  Involves  the  highest  time  pressure  of 
all  segments.  Analysis  of  the  video  recordings  for  these  conditions  with  respect  to  completion  of  the 
final  checklist  and  the  complying  with  ATC  instructions  showed  a  significant  reduce  in  the  accuracy  of 
these  cockpit  activities  during  the  single  pilot  cases  (mainly  due  to  failing  to  report  compulsatory 
reporting  points,  and  to  complete  the  final  checklist).  This  finding  (for  which  the  accuracy  of  the 
cockpit  work  can  be  regarded  as  a  kind  of  "secondary  task"  performance)  clearly  indicates  a  higher 
workload  level  for  the  single  pilot  tasks  in  comparison  with  the  corresponding  dual  pilot  tasks 
(especially  in  the  third  approach  segment). 

The  foregoing  results,  and  also  additional  findings  mentioned  in  reference  I,  show  that  a  matrix  of 
measures  is  needed  in  order  to  arrive  at  reliable  conclusions.  Although  different  measures  tend  to  result 

-  on  the  average  -  in  similar  outcomes,  each  individual  measure  seem  to  have  its  specific  weaknesses  which 
can  be  compensated  for  by  the  additional  uae  of  other  measures. 

In  the  approach  study  also  some  attention  has  been  devoted  to  examining  the  usefulness  of 
mathematical  pilot-aircraft  system  models  for  workload  analysis.  Two  models  have  been  considered,  which 
are  both  based  upon  the  optimal  control  model  framework  of  the  human  operator.  One  of  the  models,  the  so- 
called  control  effort  model  (Ref.  6)  reflects  -  in  terms  of  the  optimal  control  model  framework  -  how  hard 
the  human  controller  has  to  work  to  achieve  a  given  performance  (criterion) .  It  can  be  applied  to  manual 
control  tasks,  provided  that  an  adequate  aircraft  system  model  is  available  and  that  the  manual  control 
task  can  be  stated  in  model  terms.  The  other  model  is  an  adapted  version  of  the  so-called  Procru  model 
(Ref.  5),  and  is  capable,  among  others,  of  generating  timelines  for  the  relevant  events  during  the 
execution  of  a  ("raw"  ILS)  approach.  Within  the  context  of  this  investigation,  the  results  of  both  methods 
are  (because  of  the  afore  mentioned  restrictions)  compared  with  experimental  data  for  a  limited  range  of 
conditions  (Ref.i)  and  are  not  used  further  for  the  purpose  of  the  overall  workload  assessment  of  the 
different  task  conditions.  Within  the  context  of  this  paper  it  can  be  mentioned  that  the  results  from  both 
methods  agree  fairly  well  with  the  corresponding  experimental  data.  Besides,  some  findings  with  respect  to 
control  effort  model  parameter  (E)  will  be  discussed  further  in  the  following  section  in  connection  with 
the  estimation  of  the  so-called  "Indifference  margins." 

Overall  assessment  strategy 

An  important  objective  of  the  approach  study  concerns  the  investigation  of  an  assessment  strategy  which 
satisfies  the  basic  ideas  and  aims,  as  stated  in  the  foregoing.  One  important  issue  concerns  the  power  of 
the  tests  to  be  performed,  in  connection  with  the  formulation  of  the  mentioned  "minimal  differences  of 
interest".  The  power  of  an  analysis  of  variance  depends,  among  other  things,  on  the  relative  magnitude  of 
an  observed  difference  with  respect  to  the  standard  deviation  of  the  residual  (i.e.  error)  variation,  and 
also  on  the  sample  size.  This  is  illustrated  in  figure  6  for  the  hypothetical  case  of  an  analysis  of 
variance  involving  two  experimental  conditions.  The  figure  shows  that  powerful  assessments  can  already  be 
obtained  on  the  basis  of  a  few  observations,  if  the  observed  differences  between  the  mean  values  (AM)  of 
the  pertinent  variables  are  larger  than  circa  0.8  of  the  standard  deviation  of  the  residual  random  (error) 
variation  (SD  ) .  Now,  a  safe  strategy  with  respect  to  the  choice  of  the  magnitudes  of  the  aforementioned 
indifference  margins,  would  be,  to  let  these  margins  (for  each  workload  measure)  be  larger  than  the 
standard  deviation  of  the  remaining  random  variation  (occurring  in  the  data  of  the  pertinent  workload 
measure) . 

Figure  6  shows  also  that  it  is  not  useful  to  trace  differences  between  conditions  (AM)  which  are 
smaller  than  about  0.1  of  the  standard  deviation  of  the  residual  error  variation  (due  to  the  small  power) 
even  if  large  sample  sizes  are  used.  Such  small  effects  can  adequately  be  considered  as  non-existent  as 
their  eventual  presence  cannot  be  confirmed  with  a  reasonable  power  even  under  strictly  controlled 
laboratory  conditions. 

If  an  observed  difference  falls  within  the  region  between  0.1  SD  and  the  magnitude  of  the  chosen 
indifference  margin,  it  should  be  qualified  -  by  convention  -  as  being  non-interesting.  In  the  study,  the 
term  "slightly  different"  is  used  to  reflect  the  possibility  that  in  the  case  of  multiple  comparisons 
among  conditions,  several  succeeding  "non-interesting"  differences  can  accumulate  into  a  difference 
(between  conditions  which  lie  relatively  far  apart)  of  such  a  magnitude  that  it  exceeds  the  magnitude  of 
the  chosen  indifference  margin.  As  a  consequence,  the  outcomes  of  workload  assessments  (if  based  upon  a 
comparison  between  different  conditions)  can  be  categorized  by  one  of  the  three  aforementioned 
qualifications.  That  is  to  say,  the  workload  levels  at  different  conditions  can  be  qualified  as  being 
either  mutually  "identical",  "slightly  different"  (i.e.  practically  indentical) ,  or  (clearly)  "different". 


Now  it  is  important  to  determine  for  each  measure  the  magnitude  of  (the  standard  deviation  of)  the 
error  variation  (SD  in  figure  6)  which  remains  after  all  tracable  effects  (from  the  experimental 
variables,  from  interactions  between  factors,  and  from  covariates)  have  been  filtered  out.  The  more  we  can 
reduce  this  random  variation  in  the  data,  the  smaller  the  magnitudes  for  the  indifference  margins  can  be 
chosen  (if  it  is  desirable). 

The  determination  of  the  magnitudes  of  SDp  for  different  measures  needs  the  utilization  of  a  research 
aircraft  for  the  recording  of  the  relevant  parameters.  Subsequently,  also  an  extensive  statistical 
analysis  process  is  needed  for  filtering  out  the  (non-random)  effects  of  the  experimental  variables. 

Once,  the  magnitude  of  the  error  variation  is  known  for  a  specific  variable,  it  can  be  used  as  a 
environmental  "given"  for  assessments  under  similar  operational  conditions.  Consequently  these  values  can 
be  used  as  a  guideline  for  the  determination  of  the  criterion  values  with  respect  to  the  foregoing  three 
assessment  categories.  Table  3  presents  the  derived  SD  values  for  some  workload  measures  considered  in 
this  investigation  (The  criterion  value  of  the  model  parameter  E  has  been  based  orv  a  comparison  with 
subjective  ratings  for  the  pertinent  task  conditions).  In  this  way,  separate  assessments  can  be  obtained 
from  the  individual  measures  (if  they  are  sensitive  enough)  for  pairwise  comparions  between  conditions. 
With  respect  to  the  possible  outcomes,  for  instance  concerning  the  workload  (WL)  involved  in  conditions  A 
and  B,  the  following  notation  will  be  used: 

WL(A)  "<u  (or:  "><M,  ,  ">")  WL(B).  This  notation,  and  the  corresponding  pictorial  representation  Is 

shown  in  more  detail  in  figure  7. 

Now,  in  order  to  combine  the  separate  outcomes  .. :  individual  measures  to  obtain  the  final  assessment, 
it  is  necessary  to  valuate  the  individual  outcomes,  for  instance  by  means  of  a  five-point  scale  ranging 
from  -2  for  the  situation  WL(A)  <  WL(B)  upto  +  2  for  the  situation  WL(A)  >  WL(B) .  This  commonly  used 
valuation  scale  has  also  been  applied  in  this  study.  The  final  assessment  can  subsequently  be  based  upon 
the  sum  of  all  individual  scores  (each  referring  to  a  different  measure)  ,  expressed  as  a  percentage  ol  the 
maximal  attainable  score,  (for  which  situation  the  individual  outcomes  are  unequivocally  either  ">"  or 
"<").  As  criterion  percentages  for  deciding  between  "similar"  and  "slightly  different",  and  between 
"slightly  different"  and  "different",  are  chosen  the  values  of  30  percent  and  60  percent,  respectively  . 
(This  relatively  simple  decision  strategy  is  based,  among  others,  upon  the  experimental  finding  that  no 
serious  contradictions  occurred  ((WL(A)  >  WL(B) }  .  against  {WL(A)  <  WL(B)}  .). 

The  resulting  final  workload  assessment  witf?efisplc£  to  the  dual  pile*:  approacfiSi:Iik^  is  presented  in 
figure  8  (which  is  based  on  subjective  ratings  of  subject  pilots  and  safety  pilots,  and  on  the  heart  rate 
of  the  subject  pilots  as  these  were  the  only  measures  which  could  cover  the  whole  range  of 
taskconUitions) . 

The  final  assessment  with  respect  to  the  single  pilot  versus  dual  pilot  conditions  is  presented  in  figure 
9.  (This  assessment  is  based  on  the  aforementioned  measures,  and  on  "error  rates"  reflecting  the  accuracy 
of  the  cockpit  work).  The  results,  which  are  of  course  open  to  future  adaptations,  can  be  used  as  a  basis 
for  collating  and  integrating  the  results  of  other  workload  assessment  techniques. 


Helicopter  instrument  flying  experiment 
Experimental  program 

The  experimental  study  has  been  carried  out  in  1976  as  part  of  a  research  prog rar?  for  the  Royal 
Netherlands  Air  Force  (Refs.  7,8).  The  aircraft  used  was  an  Alouette  III  helicopter  which  had  been 
modified  for  the  instrument  flying  tasks  and  for  the  measurement  and  recording  of  the  relevant 
experimental  parameters.  The  instrument  flying  tasks  consisted  of  hovering  at  600  ft  above  ground  level 
(AGL)  with  minimal  horizontal  (ground)  speed  and  of  flying  along  a  track  o£  approximately  6  NH  with  an 
indicated  airspeed  of  60  kts,  at  either  600  ft  or  150  ft  AGL.  (These  latter  tasks  are  referred  to  as  the 
high  navigation  and  the  low  navigation  tasks,  respectively).  The  instrument  information  consisted  of  the 
three  attitude  angles  (provided  by  a  three-axis  ADt),  height  deviation,  horizontal  velocity  components  (in 
case  of  the  hover  task  and  indicated  by  the  flight  director  bars)  and  cross-track  deviation  (in  case  of 
the  navigation  tasks  and  indicated  by  the  vertical  flight  director  bar). 

Four  military  helicopter  pilots  participated  as  subject-pilots  in  the  experiment.  Besides,  a  safety 
pilot  was  responsible  for  the  flight-operational  aspects  of  the  measurements.  Each  experimental  sortie 
included  two  3-minute  hovering  runs,  and  four  5-minute  navigation  runs  (150/600  ft).  Subjective  ratings 
were  requested  after  each  run.  To  prevent  outside  view  during  the  instrument  flying  tasks,  a  yellow  screen 
was  installed  and  the  subject-pilot  was  wearing  blue  goggles  (Figs,  10  a,b).  In  total  24  sorties  were 
completeu.  The  workload  measures  included  in  this  investigation  are  summarized  in  table  4. 


Results 

Some  important  results  from  the  helicopter  *lying  study  can  be  summarized  as  follows: 

A  factor  analysis  of  the  data  to  indentify  different  (i.e.  orthogonal)  dimensions  constitued  by 
combinations  of  measures  from  different  modalities,  showed  no  indication  for  a  common  dimension  which 
could  characterize  the  whole  set  of  data  with  loadings  from  all  four  modality  groups  of  measures  (i.e. 
physiological,  subjective,  performance,  and  control  activity).  Moreover,  different  tasks  (navigation, 
hover)  result  in  a  different  composition  of  the  dimensions  (see  tables  5,  6).  So,  although  a  combination 
of  different  measures  offers  the  best  possibilities  to  quantify  a  complex  concent  like  workload,  there  is 
no  indication  in  favour  of  a  superior  combination. 

Similarly,  large  intercorrelations  among  the  data  from  different  measures  have  been  found.  The 
intercorrelation  matrix,  however,  shows  a  different  pattern  for  different  tasks.  This  indicates  that  the 
considered  measures  tend  to  result  (on  the  average)  in  similar  outcomes,  but  their  sensitivity  seems  to  be 
dependent  upon  the  task  in  which  they  are  used.  (This  finding  indicates  also  the  need  for  an  examination 
of  the  specific  sensitivities  of  the  measures  -  according  to  the  rules  outlined  in  the  first  study  - 
before  arriving  at  final  conclusions). 


The  hover  task  has  been  assessed  as  Che  most  demanding  Cask,  followed  by  both  navigation  tasks  at  an 
identical  workload  level.  This  conclusion  has  been  based  upon  subjective  ratings,  heart  rate  variability 
scores  (RMSSD  and  log  ABP)  ,  and  respiration  frequency  which  did  discriminate  the  best  between  the  tasks 
(Ref.  7),  as  well  as  upon  an  model  analysis  (control  effort  parameter  E;  Ref.  8). 

Besides.the  strength  of  association  between  the  data  from  different  measures  appeared  to  be  larger  in  a 
relatively  high  workload  task  condition  (hover  task)  than  in  a  relatively  low  workload  tasks  (navigation 
tasks) . 

-  Control  activity  measures  and  skin  resistance/conductance  measures  appear  to  the  least  discriminative 
with  respect  to  workload  aspects.  Especially  in  a  relatively  high  workload  situation  it  apprear9  that  they 
constitute  a  reparate  group  of  measures  (see  table  6). 

Finally,  table  7  shows  the  average  values  for  most  parameters  related  to  the  three  task  conditions. 

The  underlined  results  concern  measures  which  are  also  considered  in  the  first  study.  The  table  shows  that 
the  indifference  margins  derived  in  the  approach  study  (namely  2.5  b.p.m.  for  M  heart  rate,  0.2  b.p.m. 
for  RMSSD  heart  rate,  0.3  for  the  demand  scale  and  1.0  dB  for  the  control  effort  parameter  F.)  ,  would  also 

be  a  useful  reference  criterion  for  deriving  conclusions  from  the  helicopter  flying  tasks:  a  final 

workload  assessment  of  tasks  based  on  these  four  measures  according  to  the  rules  set  forth  in  the 
foregoing  would  lead  to  the  same  conclusions  as  drawn  in  the  helicopter  flying  investigation. 

Note  that  the  performance  index  J  indicates  the  same  conclusion.  The  results  from  other  measures 
(e.g.  SCL,  SSR,  and  safety  pilot  rating)  do  not  indicate  such  a  pronounced  differentiation  in  workload 
between  the  hover  and  the  navigation  tasks.  Whether  this  is  due  to  i  ^educed  sensitivity  of  these 
measures  or  not,  could  not  be  traced  anymore.  (The  discussions  in  references  7,  8  suggest  a  reduced 
sensitivity,  due  to  interaction  effects,  as  a  possible  cause). 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  workload  measures  considered  in  both  studies  tend  to  give  rise  -  in  the  case  of  a  sufficient 
sensitivity  -  to  similar  outcomes  (There  were  no  serious  contradictions  found  between  the  individual 
results  of  different  measures). 

All  measures  have  their  specific  deficiencies.  Therefore  the  simultaneous  use  of  different  measures 
is  needed  to  increase  the  reliability  of  the  assessment. 

The  sensitivity  of  several  workload  measures  seems  to  be  dependent  upon  task  related  aspects.  This 
is  especially  apparent  under  relatively  low  workload  conditions.  It  is  therefore  recommended  to  assess  the 
sensitivity  of  each  measure  first  (e.g.  on  basis  of  observed  interactions  between  different  variables,  or 
based  on  effects  of  intervening  variables)  before  drawing  conclusions.  Subsequently,  it  can  be  expected 
that  a  relatively  simple  decision  strategy  will  already  be  sufficient  with  respect  to  the  formulation  of 
the  final  conclusions  (based  on  different  measures). 

It  seems  satisfactory  to  formulate  the  conclusions  (concerning  possible  differences  in  workload 
between  different  task  conditions)  on  the  basis  of  the  categorization  "non-dif f erent" ,  "slightly 
different",  or  "different".  These  categories  are  related  to  so-called  "indifference  margins"  with  respect 
to  the  observed  variation  in  the  data. 

Subsequently  the  drawing  of  an  "overall"  conclusion  in  which  the  individual  outcomes  of  several  measures 
have  to  be  integrated  can  be  based  also  on  a  relatively  simple  decision  strategy.  The  criterions  for  these 
decision  strategies  are  stated  by  convention.  These  criterions  should  eventually  be  refined  in  future 
investigations.  Also,  the  utilization  of  a  weighting  function  with  respect  to  the  separate  outcomes  of 
individual  measures  is  to  be  considered  in  future  investigations. 

Measures  based  upon  subjective  ratings  (McDonnell’s  demand  scale)  and  heart  rate  level  appear  to  be 
suitable  for  utilization  in  a  wide  range  of  tasks.  The  overall  performance  index  J  and  the  control  effort 
(model)  parameter  E  (Ref.  6)  seem  also  to  be  useful  workload  measures  for  manual  control  tasks  which  can 
adequately  be  specified  in  model  terms.  Skin  resistance  measures  and  control  activity  measures  seem  to  be 
less  adequate  as  workload  indicators.  The  usefulness  of  measures  of  heart  rate  variability  and  respiration 
frequency  (  in  non-verbal  tasks)  should  be  considered  further. 

There  is  a  clear  need  to  include  more  measures  of  different  modalities  within  a  matrix  of  workload 
measures.  Such  measures  should  preferably  be  sensitive  to  workload  aspects  for  a  wide  variety  of  tasks. 
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TABLE  i 

Task  conditions  for  the  fixed-wing  aircraft  approach  experiment 


Task 

Control 

Number  of  \ 

Approach 

Condition 

Mode 

Crew  Members 

Aid 

a 

Autopilot 

2 

ILS+FD/AP 

b 

Manual 

2 

ILS+FD 

c 

Manual 

2 

ILS 

d 

Manual 

1 

ILS 

e 

Manual 

2 

VOR+DME 

f 

Manual  , 

2  ! 

NDB 

g 

Manual 

1 

NDB 

h 

Manual  with 
trim  malfunction  i 

...  1 

2 

. 

NDB 

TABLE  2 

Considered  workload  measures  in  the  fixed-wing  aircraft  approach  study 


Pilot  Ratings 

1.  McDonnell's  10-point  demand  scale  (Ref.  2,  Fig.  3) 

2.  SWAT  3x3  rating  matrix  (Ref.  3) 

3.  Pre-  and  postexper imental  ranking  of  task  conditions 


Physiological  Measures 

1.  Heart  rate:  basic  statistics  of  the  instantaneous  heart  rate  (M,  SD ,  RMS,  RMSSD) 


Primary  Task  measures 

1.  Task  performance  (flight  accuracy) 

2.  Control  activity:  basic  statistics 

Model  Measures 

1.  Control  effort  (Ref.  6) 

2.  Task  "husvness"  (Ref.  5) 


Other  Measures 

1.  Cockpit  work  accuracy  ("error1 


f  requenc  ies) 
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TABLE  3 


Magnitudes  of  the 
variation 


standard  deviation  of  the  (residual)  error 
for  a  variety  of  workload  measures 


MEASURE 

SD  error  j 

Task  Demand  ratings* 
(10-point  scale) 

0.33 

(0.50) 

SWAT  ratings 
(100-point  scale) 

7.5 

(8.5)  ; 

M  Heart  rate 
(b.p.m,) 

2.5 

RMS  Heart  rate 
(b.p.m.) 

3.0 

SD  Heart  rate 
(b.p.m.) 

0.5 

RMSSD  Heart  rate 
(b.p.m.) 

0.2 

Control  Effort  (E) 
model  parameter 
(dB) 

1.0** 

safety  pilot  ratings 
*  McDonnell's  demand  scale 

**  Corresponds  -  in  model  terms  -  to  circa  20  percent 
reduction  in  Che  attention 


TABLE  A 

Measures  considered  in  the  helicopter  flying  experiment 


Pilot  ratings 

1.  McDonnell* s  10-point  demand  scale  (Ref.  2,  Fig.  3) 

2.  Task  effort  10-point  scale  (only  the  numbers  0  up  to  10  are  indicated  in  this  scale) 
Physiological  measures 

1.  Heart  rate:  basic  statistics;  average  band  power  (ABP)  in  the  frequency  band  .06  to  .21  Hz 

2.  Respiration  frequency:  the  average  number  of  inhalations  per  minute. 

3.  Skin  resistance  measures:  resistance  response  (SSR)  and  resistance/conductance  level  (SRL/SCL) 

Primary  task  measures 

1.  Performance  index  J: 

Jhovec  *  (RMS  h/V2  +  imS  V\>’ 

Jnav  -  (RMS  h/t^)2  +  (RMS  y/yL)2 

in  which:  h  -  height  error,  »  horizontal  speed,  y  -  cross-track  deviation,  L  -  display  limit 

2.  Control  activity:  longitudinal  cyclic  control  input  (6C),  lateral  cyclic  control  input  (6^)  tail 
rotor  pedal  control  input  (dr)  and  collective  pitch  control  input  (CP) 


Model  Measures 

1.  Control  effort  (Ref.  6) 


TABLE  5 

Rotated  factor  matrix  for  the  different  variables  of  the  n; 
tasks  (4  subjects,  42  runs).  Only  variable- factor  correlat 


TABLE  7 

Average  values  of  various  workload  measures 
for  the  helicopter  flying  tasks  (Refs.  7,8) 


M  heart  rate  (b.p.m.) 

RMSSD  heart  rate  (b.p.m.)  ^ 

log  ABP  (-) 

Respiration  freq.  (inh/min)  j 
SCL  (uMho/cm2) 

SRR  (klicm2) 

Safety  pilot  effort  rating  | 
Subject  pilot  effort  rating  : 
Subject  pilot  demand  rating  i 
Control  Effort  (dB)  j 

Overall  performance  J  (-) 


7  7.8  [  7  7.7 _ 87.4 

2.0  [  _  _2 .1 _ 1.8 

0.8  0.8  0.7 

18.0  !  18.3  19.8 

36.8  38.1  34.2 

0.27  i  0.22  0.28 

3.5  4.8  5.6 

4.9  5.4  6.2 

5.5  _ 5.7  _  6.6 

1 5 . 1_  _  j_  _  j  5 . 0  _  _  1 6 . 5 

0.25  |  0.20  ,  0.95 
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6  Power  functions  for  analysis  of  variance  F-tests  involving  two  com 
(k-2)  for  various  sample  sizes 


ADVANCES  IN  WORKLOAD  MEASUREMENT  FOR  COCKPIT  DESIGN  EVALUATION 


Maris  M.  Vikmanis 

Armstrong  Aerospace  Medical  Research  Laboratory 
Wr ight-Patterson  Air  Force  Base,  Ohio,  U.S.A 


SUMMARY 

The  stressful  mission  environment  for  tactical  aircraft  in  the  1 990 ' s  will  require  improved  integra¬ 
tion  of  pilot  and  machine  to  assure  successful  operations.  A  key  to  these  improvements  will  be  the 
development  and  proper  use  of  combat  automation  to  control  and  reduce  pilot  workload.  Concepts  such  as 
decision  aiding,  automation  of  fire/flight  control,  on-board  terrain  data  bases,  and  sensor  fusion  are  but 
a  few  of  the  technologies  that  will  potentially  contribute.  The  selection  of  technologies  for  full-scale 
development  and  final  integration  in  new  aircraft,  and  upgrades  to  current  ones,  will  require  trade-off  of 
cost  and  effectiveness.  Techniques  for  quantitative  measurement  of  pilot  workload  and  performance  are 
needed  to  assist  in  this  selection  and  ensure  that  final  cockpit  integration  does  indeed  result  in  reduced 
workload  and  improved  overall  pilot/vehicle  effectiveness. 

Research  at  the  Armstrong  Aerospace  Medical  Research  Laboratory  (AAMRL)  has  focused  on  the  development 
of  these  quantitative  pilot  performance  and  workload  measures.  Improved  methods  for  defining  pilot 
functions,  tasks,  and  performance  variables  have  been  developed  along  with  test  design  and  data  analysis 
techniques  to  support  cockpit  evaluations.  Significant  advances  in  the  measurement  of  workload  have  been 
made  over  the  last  several  years  using  subjective  and  neurophysiological  techniques.  Research  on  measures 
of  pilot  situation  awareness  and  decision  making,  critical  toward  understanding  the  pilot  interface  with 
automated  systems,  is  underway.  The  approach  in  these  efforts  at  AAMRL  has  been  to  establish  a  solid  base 
of  Laboratory  research  followed  by  the  test  and  evaluation  of  measurement  techniques  in  complex  flight 
simulators  and  then  actual  flight  experiments.  Finally,  technology  has  been  packaged  into  computer-oased 
aids  and  instrumentation  systems  so  that  they  can  be  transitioned  to  the  cockpit  development  and  design 
community. 


INTRODUCTION 

The  tremendous  strides  in  sensors,  communications,  and  electronics,  to  name  a  few,  applied  to  tne 
development  of  advanced  combat  automation  will  allow  the  modern  pilot  to  become  a  tactical  battle  manager, 
significantly  reduce  his  overall  workload,  and  improve  the  mission  effectiveness  of  our  future  tactical 
aircraft.  True?  We  all  hope  that  it  is,  but.  it  is  more  accurately  a  statement  of  the  objective  of  design 
and  not  a  given  outcome.  Rather,  new  combat  automation  technologies  will  allow  the  opportunity  f*>r 
exciting  new  cockpit  design  options,  but  also  significant  challenges  with  respect  to  technology  selection, 
detailed  design  and  cockpit  integration.  Some  early  applications  of  automation  technology  indeed  have 
resulted  in  workload  problems  reportedly  due  to  poor  display  of  relevant  information  and  a  lack  of  pilot 
confidence  in  the  system  that  was  designed  to  help  him.  Pilots  have  allegedly  "turned  the  black  box  otf" 
as  a  result  of  these  integration  problems.  Clearly,  this  is  not  a  desirable  outcome  of  the  design  process, 
particularly  since  properly  integrated  automation  should  help  the  pilot,  and  indeed  may  be  essential  to 
safely  and  effectively  accomplish  missions  under  difficult  conditions  such  as  low  level,  high  speed, 
night,  in  weather,  and  in  high  density  threat  environments.  Quantitative  methods  for  design  evaluation 
that  consider  both  mission  and  pilot  performance  are  required  to  ensure  proper  cockpit  integration. 

For  most  complex  design  problems,  measurement  of  actual  performance  and  comparison  with  desired 
performance  is  an  iterative  process  as  the  design  evolves  and  shortcomings  are  fixed.  This  is  not 
necessary  if  system  elements  have  known  models  or  performance  characteristics,  in  which  case  the  design 
can  be  determined  analytically  and  the  actual  performance  predicted  with  good  reliability.  Note,  however, 
that  quantitative  predictive  models  of  human  information  processing  and  cognition  do  not  currently  exist. 
Traditional  1  v  ^.oexpits  have  been  designed  by  yet  another  method  that  can  best  be  described  as  the  subject 
matter  expert  approach.  Here,  designers  that  are  familiar  with  past  practices  and  their  good  and  bad 
features,  extrapolate  a  new  design  and  often  consult  the  opinions  of  the  users,  that  is  the  pilots.  This 
works  well  where  new  requirements  are  not  significantly  different  from  the  past.  It  is  argued  that  lhta 
approach  is  not  sufficient  to  meet  the  challenges  of  "the  Man/Machine  Interface  in  Tactical  Aircraft 
Design  and  Combat  Automation,"  which  is  the  subject  of  this  symposium.  The  emerging  technologies  mentioned 
earl  ier  and  their  innovative  use  in  combat  automation  will  change  the  traditional  role  ot  the  pilot. 
Therefore,  cockpit  design  and  the  integration  of  combat  automation  will  have  to  rely  on  quantitative 
methods  to  measure  goodness  and  performance  of  the  various  options.  Indeed  quantitative  measures  of 
design  goodness  will  help  replace  some  of  the  art  in  cockpit  design  with  engineering  practice. 

MEASURES  OF  GOODNESS:  MULTIDIMENSIONAL  ASPECTS 


In  the  end,  a  tactical  aircraft's  worth  is  measured  by  its  survivability  and  ability  to  deliver 
weapons  on  targets.  Combat  automation,  other  aircraft  systems,  the  enemy,  environment,  mission 
objectives,  and  of  course  the  pilot  contribute  to  this  overall  effectiveness.  Toward  that  end  the 
pilot's  performance  of  mission  tasks  must  be  measured  as  it  relates  to  cockpit  and  automation  options. 
In  general,  these  measures  a»*e  in  terms  of  accuracy,  timeliness,  and  probabilities  of  actions.  On  the 
surface  then  pilot  performance  measurement  seems  easy,  first,  specify  the  tasks,  then  the  appropriate 
measures,  run  a  test,  and  analyze  the  data.  Several  factors  complicate  this  process  however. 


Pilot  functions  and  tasks  are  difficult  to  formally  specify  and  many 
processes  such  as  problem  solving,  planning,  and  decision  making.  A  very 
human  behavior  was  developed  by  Rasmussen  (ref.  1)  (Fig.  1).  Skill -based 
response  activities,  for  example  control  of  the  aircraft  flight  path  over 
performance  involves  complex  series  of  actions  such  as  the  execution  of  a 


of  them  involve  complex 
useful  framework  for  levels  of 
performance  involves  sensory- 
easy  terrain.  Rule-based 
weapon  delivery  sequence  in  a 


ground-attack  mission,  finally,  knowledge-based  behavior  is  character ized  by  unknown  situations,  decision 
making  and  planning.  An  important  role  of  the  pilot  in  today's  and  any  future  aircraft  is  to  handle 
uncertainties  such  as  threats,  weather,  malfunctions,  and  changes  in  mission  objectives,  which  is 
character ist ic  of  the  knowledge  level.  Measurement  of  this  performance  is  difficult.  What  is  the 
probability  of  making  a  good  decision,  assessing  the  situation  correctly,  making  an  error? 


GOALS 


SENSORY  INPUT 


Figure  i.  Levels  of  Pilot  Performance 


Other  factors  affect  or  help  shape  a  pilot’s  performance  of  these  complex  tasks.  The  imposed  demands 
of  the  mission  (goals,  environment,  scenario,  aircraft  design)  combined  with  personal  character  ist res 
(capabilities,  skills,  experience,  biases)  result  in  his  level  of  workload.  The  concept  of  workload  stems 
from  the  psychological  construct  that  humans  possess  various  mental  resources  which  are  depleted  during  the 
performance  of  tasks.  As  functions  are  automated  in  future  aircraft,  pilots  will  still  be  responsible  for 
monitoring  the  health  and  status  of  this  automation.  The  attention  required  for  this  new  function  must  be 
compared  to  the  benefits  of  the  automation.  Does  the  level  of  pilot  workload  really  matter  as  long  as  the 
mission  gets  performed?  Yes,  in  the  same  sense  that  we  design  electronic  circuits  within  their  capacity  to 
handle  required  power  levels.  Components  that  operate  outside  design  ranges  have  higher  probabi 1  it ies  of 
failure.  To  carry  this  analogy  to  its  end,  heat  is  probably  not  a  performance  variable  for  the  circuit, 
voltage  or  current  is  of  interest.  For  the  pilot ,  workload  is  a  necessary  variable  to  be  factored  into 
the  design  problem. 

The  use  of  machine  intelligence  technology  in  future  combat  automation  will  require  an  assessment  of 
pilot  confidence  in  the  system.  This  will  reflect  how  well  system  state, dynamics,  and  even  limitations 
are  understood  by  the  pilot.  This  type  of  information  may  have  to  be  displayed  to  enhance  confidence  and 
trust,  so  that  the  pilot  will  properly  rely  on  the  advice  and  performance  of  the  machine  aid. 

Pilot  physical  and  psychological  state  ‘Mriables  affect  task  performance  as  well.  Some  examples  are 
levels  of  fatigue,  the  effects  of  acceleration,  and  combat  stress  just  to  name  a  few.  These  are 
essentially  initial  conditions  and  also  must  be  measured  or  known  in  order  to  make  assessments  of  overall 
pilot,  performance. 

Assessment  of  the  goodness  of  combat  automation  and  cockpit  integration  requires  the  measurement  of 
inul  t  id imensi  nal  aspects  of  pilot  state  and  performance.  Research  at  AAMRL  is  focused  toward  the  develop¬ 
ment  of  measurement  methods  and  tools  to  aid  in  the  evaluation  of  cockpit  designs  and  combat  automation 
alternat.  ives.  Some  of  the  results  of  this  research  are  summarized  in  the  following  sections. 

SYSTEM  ANALYSIS 

A  necessary  first  step  in  any  design  evaluation  is  system  analysis.  Formal  descriptions  of  system 
performance  goals,  functions,  structure  and  detailed  design  are  a  part  of  the  analysis  process. 

Electronics,  aerospace,  mechanical  and  most  other  engineering  fields  have  evolved  forma)  procedures  and 
conventions  for  analysis.  The  field  of  human  engineering,  or  human/machine  system  design,  has  traditionally 
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used  techniques  such  as  task  analysis  to  support  this  process.  These  have  not  however  been  sufficiently 
formal  and  complete  enough  to  capture  goals,  function  allocation,  information  flows,  and  overall  human/ 
system  structure. 

Research  at  AAMRL  has  resulted  in  the  development  of  the  User -Ass isted  Generic  System  Analyst's 
Workstation  (GENSAW)  to  support  a  structured  and  disciplined  human/machine  system  analysis.  GENSAW  will 
eventually  provide  a  cohesive  set  of  computer-based  tools  to  aid  systems  description,  performance  data 
base  management  and  analysis  (Fig.  2).  All  of  these  capabilities  have  not  been  fully  developed,  but 
Version  2  of  GENSAW  has  three  tools  which  are  currently  available  for  use  in  cockpit  design  and  evaluation. 


o  ETC 


RESULTS 


ANALYSES  TO  INCLUDE 


o  EVENT  ANALYSES 
o  RESOURCE 
ALLOCATION 
o  BOTTLE  NECKS 
o  CRITICAL  PATHS 
0  MODELING 
o  COMPUTER 

SIMULATION  (e.g. 
MICROSAINT ) 


Figure  2.  The  GENSAW  Concept 


First,  is  a  user-assisted  Automated  System  Decomposition  ( ASD )  program  that  allows  one  to  develop  a 
structured  functional  representation  of  a  system.  It  uses  a  technique  called  IDEF  ( I  CAM  Definition,  ICAM 
in  turn  is  an  acronym  for  Integrated  Computer  Aided  Manufactur i ng }  which  was  developed  by  the  Air  Force 
Wright  Aeronautical  Laboratory’s  Materials  Laboratory  (ref.  2).  This  is  based  on  an  approach  from 
structured  software  definition  and  accounts  for  a  system’s  functions,  inputs,  outputs,  controls  and 
resources.  These  features  are  very  useful  in  describing  human/machine  systems  such  as  a  pilot's  interface 
with  his  cockpit,  aircraft  systems,  and  outside  environment.  Controls  represent,  constraints  or  guidelines 
in  performance  of  a  function  such  as,  for  example,  tactical  doctrine  or  other  required  operational 
p»ocedures.  Resources  are  the  physical  entities  that  actually  accomplish  the  function  which  could  be  the 
pilot,  combat  automation,  on  other  aircraft  system.  This  feature  provides  a  useful  audit  trail  during 
design  function  allocation  and  the  determination  uf  performance  measures.  The  ASD  program  allows  a  user 
to  interact ive ly  decompose  a  system  into  parts  starting  from  the  top  level  mission  function.  The  display 
screen  graphically  depicts  the  resulting  human/machine  function  architecture.  In  addition,  the  performance 
measures  that  would  be  assigned  to  individual  functions  could  be  related  to  upper  level  functions  and 
eventually  overall  effectiveness. 

The  ASD  computer  program  also  provides  for  the  development  of  matrix  data  indicating  the  relationship 
between  inputs,  outputs,  resources,  and  controls.  Diagramming  logic  is  checked  automat ical ly  and  tables, 
bar  graphs,  information  traces,  and  the  matrices  can  be  displayed.  ASD  is  currently  hosted  on  a  VAX  11/780 
computer  and  a  Micro  Vax  II  Workstation. 

An  interactive  computer-based  analysis  tool  called  the  User-Assisted  Test  and  Evaluation  Methodology 
Assistant  Program  (TEMAP)  has  also  been  developed.  This  aids  a  user  in  management  of  a  complex  man-in-the- 
loop  test  and  evaluation  program,  such  as  a  full  mission  simulator  evaluation  of  cockpit  design  or  actual 
flight  testing.  The  program  actually  uses  IDEE  to  structure  the  steps  of  the  test  and  evaluation.  Each 
step  is  accompanied  by  helpful  material  on  factors  to  consider,  techniques,  guidelines,  solutions  to 
problems,  and  applicable  references.  As  a  user  specifies  the  details  of  the  test  and  evaluation  program, 
a  data  file  is  created  that  can  be  used  to  document  the  overall  project.  Examples  of  data  to  be  specified 
are  performance  measures,  numbers  of  test  pilots,  scenario  details,  and  data  collection  schedule.  TEMAP 
has  been  hosted  on  a  VAX  11/780,  MICRO  VAX  II  Workstation,  and  IBM  compatible  personal  computers. 

The  third  computer  program  currently  available  is  the  User-Assisted  Automated  Experimental  Design 
Program  (AED).  Proper  specification  of  independent  and  dependent  test  variables  for  a  complex  evaluation 
in  a  full  mission  cockpit  simulator  can  be  difficult  to  accomplish  manually.  Interactions  between 
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variables  and  confounds  must  be  known.  In  addition,  it  may  be  more  cost  effective  to  run  several  small 
studies  rather  than  one  large  test.  AED  allows  a  user  to  create  or  call  pre-stored  full  and  fractional 
factorial  experimental  designs.  It  is  an  aid  for  performance  data  management  and  obtaining  stat i st ical ly 
meaningful  test  results.  AED  is  hosted  on  the  same  computers  as  TEMAP. 

SUBJECTIVE  WORKLOAD  ASSESSMENT 

The  subjctive  assessment  of  workload  is  an  effective  method  particularly  in  operational  and  complex 
simulator  evaluations.  It  is  based  on  the  premise  that  if  an  operator  feels  loaded  and  must  use  consider¬ 
able  effort  while  performing  his  tasks,  he  really  is  loaded  and  effortful.  This  may  in  particular  be 
true  prior  to  actual  performance  degradation  when  subjective  feelings  indicate  the  added  effort  that  is 
being  expended.  Subjective  measures  offer  the  potential  of  being  relatively  nonintrusive  to  the 
performance  of  '•'»  primary  mission  tasks. 

Research  at  the  Armstrong  Aerospace  Medical  Research  Laboratory  has  resulted  in  the  development  of 
the  Subjective  Workload  Assessment  Technique  (SWAT)  (ref.  3).  SWAT  solves  some  of  the  historic  problems 
with  subjective  assessment  that  suffered  from  limitations  because  of  nonstandardized  measurement  scales. 

A  technique  called  conjoint  measurement  is  used  to  construct  interval  workload  scales  from  purely  ordinal 
rankings  of  subjective  load  levels.  SWAT  uses  algorithms  that  are  directly  identified  from  the  subjective 
data  to  represent  the  joint  effect  of  several  underlying  factors.  These  rating  factors  have  been  adopted 
from  a  theoretical  framework  for  workload  assessment  developed  by  Sheridan  and  Simpson  (ref.  4).  SWAT 
assumes  that  subjective  workload  can  be  represented  by  a  combination  of  three  levels  of  time  load,  mental 
effort  load  and  psychological  stress  as  defined  below: 

T ime  Load 


1.  No  or  very  few  interruptions  in  the  planning,  execution,  or  monitoring  of  tasks.  Spare  time 
exists  between  many  tasks. 

2.  Task  planning,  execution,  and  monitoring  are  often  interrupted.  Little  spare  time.  Tasks 
occasionally  occur  simultaneously. 

3.  Task  planning,  execution,  and  monitoring  are  interrupted  most  of  the  time.  No  spare  time.  Tasks 
frequently  occur  simultaneously.  Considerable  difficulty  in  accomplishing  all  tasks. 

Mental  Effort  load 


1.  Little  conscious  mental  effort  or  planning  required.  Low  task  complexity  such  that  tasks  are 
often  performed  automatically. 

2.  Considerable  conscious  mental  effort  or  planning  required.  Moderately  high  task  complexity  due 
to  uncertainty,  unpredictabi 1 ity,  or  unfamiliarity. 

3.  Extensive  mental  effort  and  skilled  planning  required.  Very  complex  tasks  demanding  total 
attention. 

Psychological  Stress  Load 

1.  Little  risk,  confusion,  frustration,  or  anxiety  exists  and  can  be  easily  accommodated. 

2.  The  degree  of  risk,  confusion,  frustration,  or  anxiety  noticeably  adds  to  workload  and  requires 
significant  compensation  to  maintain  adequate  performance. 

3.  The  level  of  risk,  confusion,  frustration,  or  anxiety  greatly  increases  workload  and  requires 
tasks  to  be  performed  only  with  the  highest  level  of  determinat ion  and  self-control. 

Consider  briefly  the  procedure  for  the  application  of  SWAT  to  the  evaluation  of  a  particular  cockpit/ 
automation  design  alternative  as  implemented  in  a  piloted  aircraft  simulator.  Prior  to  actual  simulator 
runs,  the  pilot  subject  pool  is  thoroughly  briefed  on  the  purpose  of  the  study  and  then  asked  to  develop 
overall  rankings  of  the  combined  workload  factors.  That  is,  the  27  combinations  of  the  three-dimensions 
and  three  levels  for  each  are  ranked  from  lowest  to  highest  by  each  pilot.  Numerical  values  for  each 
combination  are  derived  using  the  conjoint  scaling  procedure.  The  specific  mission  phases  and  tasks  to  be 
scored  should  also  be  determined  prior  to  the  data  collection.  Next  during  the  actual  simulation  run, 
the  pilot  is  asked  to  rate  each  of  the  three  load  dimensions  for  the  event  of  interest.  The  pilot  usually 
accomplishes  this  verbally  following  a  verbal  prompt  by  the  experimenter.  Some  preplanning  of  this 
administration  should  be  accomplished  so  that  it  does  not  interfere  with  the  mission  tasks  and  yet  be 
taken  temporarally  as  close  as  possible  to  the  scenario  event  to  be  scored. 

Both  laboratory  and  applications  research  has  been  conducted  to  assess  the  validity  of  SWAT  as  a 
workload  measurement  tool.  The  stability  of  subject's  judgment  over  time  was  measured  in  several  studies. 
Thirty  Air  Force  pilots  participating  in  a  study  of  air-to-air  combat  in  a  high  fidelity  simulator  performed 
the  ranking  procedure  four  months  apart.  Predictions  of  the  second  ranking  were  80%  correct  based  on  the 
original  one.  Another  check  was  performed  on  twenty-two  military  subjects  part ic  i  p  at ing  in  a  control  room 
design  evaluation.  These  checks  were  two  months  apart  and  all  except  one  subject  had.  order ing  correlated 
.90  or  greater.  It  can  be  concluded  from  these  studies  that  subjects'  internal  model  for  workload  is 
generally  stabled  over  time. 

Several  independent  studies  have  investigated  the  metric  properties  of  SWAT.  In  a  significant 
Laboratory  study  (ref.  5)  involving  over  one  hundred  subjects  SWAT  data  was  collected  on  nine  computer- 
based  cognitive  tasks,  termed  the  Criterion  Task  Set  (ref.  6)  (Table  1).  Parametric  research  has 
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established  well  defined  loading 
procedures.  The  results  of  this 
(p  <  .05)  for  the  load  levels  on 


levels  for  each  task  as  well  as  training  requirements  and  testing 
major  study  indicate  that  SWAT  ratings  were  significantly  different 
al l  the  tasks. 


Task 


Processing  Function 


Visual  Display  Monitoring 
Continuous  Recognition 
Memory  Search 
Linquistic  Processing 
Mathematical  Processing 
Spatial  Processing 
Grammatical  Reasoning 
Unstable  Tracking 
Interval  Production 


Visual  Perceptual  Input 
Working  Memory  Encoding 
Working  Memory  Storage/Retr ieva 1 
Symbolic  Information  Manipu^tion 
Symbolic  Information  Manipulation 
Spatial  Information  Manipulation 
Reason ing 

Manual  Response  Speed/^ccuracy 
Manual  Response  Timing 


Table  1  -  CTS  Tasks  and  Associated  Processing  Functions 


Other  laboratory  studies  have  investigated  procedural  aspects  of  SWAT.  An  experiment  was  conducted 
to  determine  the  effect  of  a  reporting  delay  of  up  to  thirty  minutes  for  three  levels  of  loading  on  a 
display  monitoring  task  (ref.  7).  SWAT  responses  were  not  statistically  different  as  a  function  of  the 
response  delay.  A  similar  experiment  (ref.  8)  was  run  using  short-term  memory  tasks.  This  type  of  task 
was  chosen  because  subject  recall  of  the  actual  SWAT  ratings  should  also  require  the  use  of  short-term 
memory,  therefore  constituting  a  more  rigorous  test.  Again,  however,  the  delay  conditions  did  not 
differ  significantly  from  the  initial  rating.  Another  experiment  was  conducted  that  explicitly  varied 
the  type  and  load  level  of  intervening  tasks  between  the  one  to  be  rated  and  the  actual  solicitation  of 
the  of  the  rating  (ref.  9).  Here,  no  significant  differences  were  found  as  a  function  of  the  type  of 
intervening  task.  All  these  studies  indicate  that  delay  in  obtaining  workload  ratings,  as  may  occur  in 
operational  situations,  may  not  have  a  large  impact  on  the  overall  ratings. 

In  addition  to  carefully  controlled  laboratory  experiments,  SWAT  has  been  evaluated  in  flight 
simulators  as  well.  A  series  of  experiments  on  B-5?  and  F -16  ground-based  high  fidelity  simulators  have 
been  conducted  over  the  last  three  years  (ref.  10).  The  degree  of  realism  in  these  simulators  make  it 
possible  to  generalize  the  laboratory  results  to  more  real  world  situations.  In  one  of  these  tests,  line 
pilots  from  a  B-52  squadron  served  as  subjects  and  flew  the  flight  simulator  at  Carswell  Air  Force  Base, 
Texas.  A  scenario  was  constructed  to  have  three  different  levels  of  piloting  workload  as  follows: 

Low:  Straight  and  Level  Flight 

Medium:  Normal  Descent  and  ILS  Approach 

High:  Descent  to  IIS  Approach  with  Successive  Engine  Failures,  Runaway  Trim,  and  Crosswinds 

Results  of  this  experiment  indicated  that  the  SWAT  scores  clearly  d ifferent iated  between  the  three  levels 
of  task  demand. 

Another  simulation  study  used  an  F-16  simulator  flying  an  air  defense  mission.  This  was  a  fixed 
base  F-16D  with  essential  controls  and  displays  functional  and  a  limited  f ield-of-view  outside  visual 
simulation.  Four  defensive  counter  air  scenarios  were  designed  to  capture  from  low  to  high  workload  as 
f o 1  lows : 


Low:  An  F-16  Chases  three  enemy  aircraft  making  an  "S"  weave  escape. 

Medium  Low:  Five  enemy  aircraft  approached  the  F-16  head-on. 


Medium  High:  One  enemy  fighter  approaches  the  F-16  head-on  an  5-weave  pattern;  two  enemy  fighters 
approach  head-on;  four  enemy  bombers  approach  the  F-16  head-on  behind  the  fighters. 

High:  Seven  enemy  fighters  approached  the  F-16;  two  of  the  aircraft  split  in  opposite 

direction  to  catch  the  F-16  in  a  pincher  maneuver. 


This  experiment  resulted  in  SWAT  scores  significantly  different  between  high  workload  and  all  the 
others  only,  although  the  expected  trend  can  be  seen  in  the  data  (Fig.  3).  Interestingly  physiological 
and  performance  data  had  a  similar  result,  indicating  that  there  is  perhaps  not  a  significant  overall 
workload  difference  between  the  first  three  levels.  The  whole  series  of  studies,  two  of  which  were 
highlighted  here  only,  provide  good  support  for  the  sensitivity  of  SWAT  to  variation  in  task  demand  in 
complex  simulators. 
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Figure  3.  SWAT  F-I6  Data 


The  real  objective  for  the  development  of  a  workload  measure  like  SWAT  is  to  provide  a  tool 
for  use  by  designers  to  evaluate  cockpit/automation  alternatives  in  ground-based  simulator  and  flight 
tests.  SWAT  has  been  applied  extensively  for  this  purpose  by  government  and  industry  to  evaluate  design 
alternatives,  procedures,  and  other  various  crew  factors.  Table  2  is  a  list  of  some  of  these  evaluations. 


Simulator 

F-16/F-15  Air-to-Air 

KC-135  Flight  Deck  Modernization 

A-300  Approach  and  Landing 

B-52  Long  Mission 

DC-10  Approach  and  Landing 

B-52  CG/Fuel  Level  Advisory  System 

Helicopter  Nap-of-the-Earth 

General  Aviation  Training 


Operational 

F - 16  Flight  Test 
A-10  Flight  Test 
Laser  Guided  Missile  Flight  Test 


Table  2  -  SWAT  Applications 


A  personal  computer  version  of  SWAT  (PC  SWAT)  along  with  a  detailed  user's  guide  is  now  available. 
Required  equipment  is  an  IBM  PC  or  compatible,  512K  internal  memory  and  two  floppy  disks  or  one  hard  and 
one  floppy  disk.  The  program  supports  analysis  of  data  for  up  to  30  subjects. 

NEUROPSYCHOLOGICAL  WORKLOAD  TEST  BATTERY 

The  use  of  the  body's  physiological  signals  to  assess  mental  workload  has  some  promising  features. 
First,  if  the  signals  can  be  easily  obtained,  it  could  be  relatively  unobtrusive,  that  is  the  pilot  could 
perform  the  actual  mission  tasks  without  interference.  Secondly,  the  measure  may  be  rather  immediate, 
allowing  assessment  of  workload  in  narrow  time  intervals,  as  may  be  needed  in  rapidly  changing  tactical 
aircraft  scenarios.  Histor ical ly ,  however,  they  have  not  been  very  successfully  applied.  Experimental 
resu  s  were  inconsistent  depending  on  task  and  environment,  all  measures  were  equated  in  terms  of  providing 
an  overall  level  of  "arousal,"  and  there  were  many  differences  between  individuals.  As  a  result  of 
research  sponsored  by  the  USAF  and  others,  selected  measures  of  brain  electrical  potentials,  eye  blink  and 
heart  rate  have  emerged  as  useful  indicants  of  mental  workload.  These  selected  measures  have  bepn 
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incorporated  into  a  computer-based  measurement  and  analysis  system  called  the  Neuropsycholog ical  Workload 
Test  Battery  (NWTB)  developed  by  AAMRL  (ref.  10). 

Research  over  the  past  three  years  has  been  aimed  toward  evaluating  the  measures  and  NWTB  system  in 
Laboratory,  flight  simulator  and  limited  field  settings.  Systematic  laboratory  experimentation  using 
several  of  the  standard  cognitive  tests  of  the  Criterion  Task  Set  has  been  accomplished  (ref.  11,  12). 

In  general,  it  was  found  that  components  of  the  brain  electrical  evoked  potential  varied  systematically 
with  workload  levels  on  the  different  tasks.  The  evoked  potential  is  the  brain's  response  to  a  discrete 
stimulus  such  as  an  auditory  or  visual  input.  The  eye  blink  closure  durations  in  general  were  shorter 
when  subjects  were  performing  the  tasks  versus  a  no-task  resting  condition.  The  eye  blink  data  did  not 
however  discriminate  between  loading  levels  on  the  tasks.  Taken  as  a  whole  heart  rate  was  not  sensitive 
to  workload  levels  on  these  laboratory  type  tasks.  At  first  glance,  these  results  may  not  seem  very 
supportive  of  the  utility  of  physiological  measures.  It  will  be  shown  in  the  discussions  to  follow  on 
simulator  and  flight  testing  that  the  important  point  is  that  the  proper  measurement  be  selected  with 
regard  to  sensitivity  and  time  responsiveness. 

Ground-based  flight  simulation  is  an  important  tool  for  the  evaluation  of  cockpit  and  automation 
design  alternatives.  Because  of  this,  the  measurement  of  workload  in  these  contexts  is  important.  To 
support  the  development  of  such  a  capability,  the  NWTB  was  used  to  collect  and  analyze  physiological  data 
during  the  following  8-52  and  F-16  simulator  exercises  (ref.  10). 

1.  The  pilot  station  of  a  B-52  flying  an  Instrument  Landing  System  scenario  which  included  three 
workload  levels:  straight  and  level  flight,  normal  descent  and  approach,  and  approach  with  engine  failures 
and  crosswinds. 

2.  The  tail  gunner  station  of  a  B-52  involved  in  a  hostile  target  encounter  scenario  with  three 
levels  of  workload:  high-altitude,  low-altitude,  low-altitude  with  radar  system  malfunctions. 

3.  Daytime  and  nighttime  f-16  low-level  interdiction  mission  with  ingress,  weapons  employment  and 
egress  workload  levels. 

4.  Weapon  system  operator  station  of  a  modified  two-seat  F-16  performing  four  air-to-ground  weapon 
deliveries  with  varying  levels  of  workload. 

Measures  of  eye  blink  were  emphasized  during  these  tests  and  several  of  the  parameters  were  clearly 
sensitive  to  the  manipulations  in  scenario  workload.  These  workload  manipulations  were  determined  to  be 
valid  based  on  their  face  validity  to  experts,  that  is  pilots,  and  also  a  formal  analysis  and  rating  of 
type  and  level  of  demand  imposed.  The  blink  rate  and  closure  durations  both  decreased  as  a  function  of 
increasing  workload,  in  particular  visual  input  load.  These  parameters  were  most  sensitive  when  keyed  to 
particular  mission  events  and  thus  will  be  useful  in  evaluations  that  require  time  sensitivity. 

A  study  of  physiological  measures  of  fighter  pilot  workload  during  actual  A-7D  training  flights  was 
also  recently  completed  (ref.  13).  Here  brain  electrical  potential,  eye  blink,  and  heart  rate  data  were 
collected  for  a  battle  area  interaction  mission  profile.  The  data  were  recorded  on  a  miniature  battery- 
powered  device  which  fit  in  the  pilot's  flight  suit. 

Data  was  subsequently  processed  on  the  ground  and  analyzed  by  the  NWTB.  The  A-7D  mission  required 
low-level  high  speed  flight,  navigation  and  weapons  delivery.  Results  of  this  study  have  been  very 
promising  in  that  all  the  physiological  measures  provided  useful  information  on  pilot  workload.  Heart 
rate  in  this  case  appeared  to  index  an  overall  level  of  workload  and  was  not  sensitive  to  G  stress  as 
were  the  other  measures.  Significant  effects  as  a  function  of  mission  events  resulted  and  also 
differences  in  the  same  pilot  when  flying  the  lead  versus  wing  position.  The  flight  environment  provides 
interesting  opportunities  to  observe  real  world  type  events.  An  actual  bird  strike  occurred  to  one  pilot 
after  he  had  just  cleared  some  power  lines  (fig.  4).  Note  the  pattern  in  the  variability  of  the  heart  rate 
inter-beat  interval  as  well  as  the  heart  rate  itself.  High  workload  after  the  bird  strike  was  a  result  of 
aircraft  damage  assessment  activities. 
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Figure  4.  A-7D  Physiolog ical  Workload  Data 


AAMRL  has  pursued  systematic  research  and  testing  of  physiological  measures  of  mental  workload  for 
application  to  the  design  and  evaluation  of  cockpit  and  automation  alternatives.  Results  to  date 
indicate  that  physiological  measures  have  utility,  but  each  has  its  own  sensitivity  to  loading  and  temporal 
factors. 
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Although  further  research  to  determine  specific  rules  for  application  is  ongoing,  a  preliminary 
guideline  based  on  our  experience  is  as  follows.  The  brain  electrical  measures  allow  detailed  analysis 
of  processing  workload,  but  work  best  in  well  controlled  laboratory  settings.  Eye  blink  measures  have 
utility  in  complex  simulators  particularly  where  visual  processing  load  is  of  interest.  It  also  allows 
relatively  fine  grained  time  analysis  of  workload.  Heart  rate  is  a  viable  measure  for  use  in  limited 
flight  tests  where  overall  workload  as  a  function  of  mission  events  is  of  interest. 

SITUATION  AWARENESS:  AN  EXAMPLE  ANALYSIS 

No  one  questions  the  fact  that  pilots  must  have  good  situation  awareness  to  successfully  accomplish 
missions.  Also  an  important  goal  for  new  sensor,  combat  automation,  and  cockpit  technologies  is  to 
improve  pilot  situation  awareness.  What  is  situation  awareness  and  how  do  we  know  if  it  is  improved,  or 
degraded?  Research  at  AAMRL  has  begun  to  address  these  issues  and  to  develop  quantitative  measures  of 
situation  awareness  needed  for  design  evaluation. 

Although  situation  awareness  lacks  a  formal  definition  certainly  many  are  possible  depending  on 
purpose.  In  order  to  provide  a  framework  for  our  research,  a  working  definition  somewhat  analagous  to 
a  state  space  representation  of  a  dynamic  system  has  been  proposed  {Fig.  5).  Current  state  information 
includes  geometry  and  status  information,  i.e.,  this  is  a  pilot’s  knowledge  of  where  he  is  in  his  mission, 
physical  space,  relationship  to  friendly  and  enemy  forces,  and  also  overall  aircraft  condition.  In 
addition,  knowledge  of  priorities,  probabilities,  future  trends,  and  consequences  of  the  current  state  is 
required.  It  is  proposed  that  this  total  set  of  information  and  how  it  relates  to  the  mission  objectives 
represents  situation  awareness. 
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Figure  5.  Pilot  Situation  Awareness 


A  measure  of  a  pilot's  degree  of  situation  awareness  should  necessarily  represent  these  multi¬ 
dimensional  FocLgij.  Reseat  *.ii  at  AAMRL  has  applied  a  statistical  technique  called  multidimensional 
scaling  (MDS)  to  investigate  pilot  performance  and  situation  awareness,  in  simulated  air  combat 
maneuvering  (ref.  14).  MDS  is  a  tool  for  studying  the  structure  of  data  through  measures  of  relatedness. 
This  technique  was  applied  to  an  existing  performance  data  base  obtained  from  thirty  pilots  during 
simulated  one-versus-one  air  combat  maneuvering  free  engagements.  The  performance  measures  are  defined 
in  Table  3.  For  this  analysis,  pilots  were  rated  as  expert  or  novice  depending  on  their  experience.  The 
MDS  maps  for  each  are  shown  in  (Fig.  6).  The  axes  and  respective  scales  reflect  the  dimensional ity  of  the 
data,  and  require  rather  complex  interpretation.  For  the  purposes  of  this  discussion  points  that  are 
closer  are  simply  more  related.  Experts  had  a  well  defined  cluster  on  the  left  that  was  energy  related. 
The  cluster  on  the  right  represented  air  combat  maneuvering  variables.  These  pilots  associated  mission 
success  with  offensive  and  defensive  maneuverabi 1 ity.  The  novice  pilots  lack  these  more  well  defined 
clusters.  Note  that  gun  kill  was  not  strongly  related  to  anything,  perhaps  a  reflection  of  luck,  Also, 
the  mix  of  energy  management  variables  with  offense  and  gun  range  indicate  a  dependence  on  throttle 
activity  for  offensive  air  combat  maneuvering.  Numerous  other  insights  can  also  be  obtained  from  this 
data.  To  summarize,  mission  effectiveness  data  also  indicated  that  the  experts  got  more  kills 
and  used  less  fuel. 


Performance 

Measure  Def init ion 


Altitude  Rate 
Roll  Rate 
Idle 

Mil  Power 
Speed  Brake 
Fuel  Flow 
Energy  Mgt 
Start  Position 
Out  of  View 
Offense 

Gun  Range 
Gun  Kill 


Mean  Absolute  Vertical  Speed 

Mean  Absolute  Roll  Rate  in  Deg/Sec 

Number  of  Times  Throttle  in  Idle  Position 

Number  of  Times  Throttle  in  High  Mil  Position 

Mean  Speea  Brake  Deflection 

Mean  Fuel  Flow  in  LBS/HR 

RMS  Energy  Management  Index 

Initial  Simulator  Configuration 

%  Time  Out  of  Opponent's  View 

%  Time  Opponent  Positioned  at  a  Single  Angle 

of  Less  than  60  Degrees 

%  Time  Opponent  Positioned  within  Gun  Range 
Probability  of  Gun  Kill 


Table  3  -  Simulated  Air  Combat  Maneuvering  Performance  Measures 
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Figure  6.  Air  Combat  Performance  Space 


This  type  of  statistical  technqiue  allows  the  analysis  of  the  complex  dynamics  of  air  combat  and 
insight  into  the  underlying  pilot  situation  awareness.  The  same  procedure  could  be  used  to  evaluate  the 
effects  of  combat  automation  options  and  cockpit  designs  on  a  pilot's  ability  to  manage  his  overall 
situation  awareness. 

FUTURE  RESEARCH 

Many  challenges  remain  to  be  solved  toward  the  development  of  quantitative  performance  and  workload 
measurement  techniques  for  design  evaluation.  Future  research  projects  at  AAMRl  will  address  some  of  these 
challenges.  The  Generic  System  Analyst's  Workstation  will  be  upgraded  to  include  a  network  simulation 
capability.  This  will  allow  model  prediction  of  mission  performance  from  air^'-aft  and  pilot  task  data.  A 
next  generation  Neuropsychological  Workload  Test  Battery  is  in  the  early  stages  of  development.  This  system 
will  be  ruggedized,  include  more  automated  data  analysis  and  have  a  hardware/software  architecture  that 
allows  improved  interface  with  ground  based  simulation  and  advanced  fighter  flight  testing.  The  multi¬ 
dimensional  scaling  and  other  approaches  toward  measurement  of  situation  awareness  will  be  refined  in  the 
context  of  design  evaluation.  A  new  initiative  aimed  toward  assessment  of  decision  making  in  the  cockpit 
has  also  begun.  This  will  develop  measures  of  judgement  variables,  correct  decision  likelihood  and  error 
avoidance  as  an  example.  These  new  methods  and  tools  will  further  refine  the  designer's  ability  to  make 
quantitative  evaluations  of  combat  automation  and  cockpit  designs. 
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1.  Introduction 


In  1984  we  presented  a  paper  on  "Cockpit  automation  requirements  derived  from 
mission  functions  data"  /I/.  This  was  the  first  step  to  develop  a  method  by  which  the 
Cockpit  Moding  and  the  Cockpit  Data  Management  can  be  established  systematically.  This 
first  step  included: 


Definition  of  the  design  driving  mission. 

Breakdown  of  the  mission  into  phases,  segments  and  tasks. 

-  Assessment  of  operationally  required  levels  of  automation  for  information  and  con¬ 
trol  functions  of  tasks. 


Meanwhile  the  method  has  been  extended.  It  includes: 


Assessment  of  access  time  allowed  for  information  elements  and  control  functions. 

-  Differentiation  of  the  mission  tasks  according  to  demand  type  (importance,  frequency 
of  use). 


This  method  developed  so  far  renders  the  "operational  requirements"  for  the 
cockpit  moding. 


The  steps  of  specifying  the  cockpit  moding  are  as  yet  not  so  well  defined.  That 
is  the  reason  why  we  used  the  term  "Modinq  Strategy"  instead  of  "Method"  in  the  title 
of  this  paper.  The  paper  deals  with  the  method  of  deriving  the  operational  requirements 
and  with  the  subsequent  tasks  to  be  performed  within  the  process  of  cockpit  moding. 


The  design  driving  mission  is  not  detailed  in  this  paper.  The  criteria  applicable 
to  define  and  breakdown  missions  in  different  scenarios  are  dealt  with  in  the  Report  of 
the  GCP  Working  Group  on  "Improved  guidance  and  Control  Automation  at  the  Man-Machine 
Interface"  /2/. 


In  this  paper  data  of  the  Air-to-Air  combat  mission  phase,  and  thereof  the  medium 
range  mode  are  used  for  exemplification  of  the  method. 


2.  Deriving  the  Operational  Requirements 


The  method  used  comprises  tasks  of  different  type.  These  are: 


(1)  Analytical  Tasks 


(2)  Tasks  to  identify  and  scale  assessment  criteria. 

Such  criteria  are  forming  the  "rule  base"  for  deriving  the  Cockpit  Moding. 


(3)  Assessment  Tasks. 


(1)  Analytical  tasks 


Definition  of  Design  Driving  Mission 
Mission  Analysis 

Breakdown  into  Phases,  Seqments,  Tasks 

Identification  of  Operational  and  System  Functions  related  to  the  Mission 
Tasks 


Listing  of  all  Information  Elements  and  Control  Functions  applicable  to 
the  Mission  Tasks  and  Segments. 

The  compilation  into  groups  of  elements/ f unctions  was  already  described  in 
the  1984  paper  /\/  and  in  /2/. 


For  the  purpose  of  cockpit  moding  the  information  element  grouping  had  to  be 
extended  as  shown  in  Fig.  1. 


(2)  Tasks  to  identify  and  scale  assessment  criteria 


-  Access  Time  allowed  per  Information  Element  and  Control  Function  related 
to  the  associated  mission  segment.  Scale: 


o  Essential  Information  for  the  mission  task;  immediate  access  required 
o  Highly  Desirable  Information;  reasonable  access  time  allowed 
o  Desirable  Information;  access  time  non-cr it ical . 


Task  Demand  Type  applicable  to  the  mission  tasks.  Scale: 


o  Priority  task/function  within  the  mission  segment 
o  Intermittently  required  tasks 
o  Tasks  to  be  performed  continuously. 


-  Automation  Levels  applicable  to  the  functions  performed  by  task  execution. 
These  automation  levels  were  already  presented  in  /I/  and  /2/.  Applying 
the  automation  levels  within  the  system  engineering  process  required  a 
slight  modification  of  the  scale.  The  levels  are: 


1.  Manual 

2.  Manual  augmented 

3.  Manual  augmented  -  Automatically  limited 

4.  Automatic-Manually  limited 

5.  Automatic-Manual  Sanction 

6.  Automatic 


(3)  Assessment  tasks 


The  assessment  includes: 


The  information  elements  for  access  time  allowance  within  the  mission  seg¬ 
ments  . 


The  mission  tasks  and  related  functions  for  task  demand  type  and  automa¬ 
tion  level  recommended. 


The  assessments  require  involvement  of  experienced  usei  pilots/aircrews.  It 
can  be  done  in  different  ways:  either  by  every  pilot  doing  the  assessment 
individually,  or  by  having  a  group  exercise. 


The  individual  assessment  has  been  applied  by  General  Dynamics  /3/  using 
specific  questionnaire  techniques.  It  also  was  done  by  MBB  /I/  using  a  guided 
interview  technique.  These  techniques  render  statistical  results.  We  found 
these  statistical  results  being  a  reasonable  guideline.  However,  they  are  not 
easily  to  be  transformed  into  operational  requirements. 


Therefore  we  chose  a  group  exercise  for  an  air-to-air  mission  application. 
The  assessment  formats  are  identical  for  both  types,  the  individual  and  the 
group  exercise.  The  group  exercise  has  advantages  and  disadvantages. 


Advantages: 


Individual  opinions  can  be  discussed  and  reinforced  or  turned  down. 
The  assessment  results  in  agreed  operational  requirements. 
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The  major  disadvantage  is  the  number  of  sessions  required  with  all  group  mem¬ 
bers  present.  The  exercise  required  3  sessions  for  automation  level  assess¬ 
ment,  2  for  access  time  assessment,  and  2  to  arrive  at  an  agreed  Cockpit  mo- 
ding  concept,  the  step  which  is  described  in  the  next  paragraph. 


Fig.  2  shows  the  block  diagram  for  the  elements  (1)  to  (3)  of  the  method  for 
deriving  the  operational  requirements  for  the  cockpit  data  management  in  an  integrated 
avionic  environment. 


Fig.  3-a  shows  the  summarised  results  of  the  assessment  of  the  information  ele¬ 
ments  for  access  time  requirement.  61  of  the  70  information  elements  requiring  imme¬ 
diate  access  (or  87  %)  in  the  combat  phase  are  related  to  combat  and  threat  management 
and  to  flight  reference  and  the  respective  systems.  Most  of  the  11  systems  information 
element*  are  related  to  sensors,  defensive  aids  and  to  the  flight  control  system. 


This  information  is  required  for  the  cockpit  moding. 

The  access  level  requirements  determine  the  moding  hierarchy  for  the  information 
elements  a~d  their  relevant  control  functions. 


Fig.  3-b  shows  the  summarised  results  of  the  assessment  of  task  demand  types  and 
automation  levels  for  the  tasks  identified  applicable  in  the  medium  range  combat  phase 
in  an  air-to-air  mission. 


Exemplifying  information: 


Priority  tasks  are  -in  this  phase-  mainly  combat  and  threat  management  tasks 
as  target  detection,  assessment,  prioritisation;  situation  evaluation,  esta¬ 
blishing  attack  procedures  etc. 

A  number  of  functions  relevant  in  those  tasks  are  initiated  manually  (Automa¬ 
tion  Levels  1  and  2),  and  controlled  automatically  (Levels  4  and  5). 


Intermittent  tasks  are  defense  management  and  C3I  tasks  controlled  manually 
augmented . 


Continuous  tasks  are  monitoring  tasks  concerning  systems,  resources,  data 
1  ink . 


The  group  exercise  rendered  agreed  ratings  of  the  automation  level  operationally 
required  for  the  mission  tasks.  These  operational  requirements  form  a  sound  data  base 
for  the  discussions  between  cockpit  and  sub  systems  specialists  concerning  the  func¬ 
tions  specification  for  the  sub  systems. 


3.  Establishing  a  Moding  Strategy 


These  operational  requirements  are  one  set  of  moding  factors  to  be  applied  for 
the  definition  of  the  cockpit  moding.  Other  moding  factors  have  their  origin  in: 

The  Man-Machine-Interface  knowledge  and  rule  data  base 
Operational  convent! 5ns  and/or  agreements 
The  sub  systems  capabilities 


A  method  to  define  the  moding  of  cockpit  systems,  of  displays  and  control  func¬ 
tions  was  not  developed  as  yet.  Such  a  method  would  have  to  be 


based  on  defined  principles 

performed  step  by  step  in  a  controllable  procedure 

reproduceable  and  applicable  to  all  kinds  of  ai rcraf t ,/hel icopter  cockpits  to  be 
des  ig  ned . 


Fig.  4  shows  the  block  diagram  of  the  tasks  to  be  performed 
pit  moding,  together  with  their  interrelation: 


in  defining  the  cock- 


Operational  requirements  (para.  2): 


U-4 
(  1  ) 


-  As.essment  of  access  time  allowance  to  information  elements  and  control  func¬ 
tions  . 

Assessment  of  mission  tasks. 


(2)  Operational  conventions/agreement : 

-  Allocation  of  information  packages  to  display  surfaces  for  moding  levels  de¬ 
fault,  level  1  and  level  2. 


(3)  Moding 


Define  basic  moding  functions  and  principles. 
Define  categories  and  moding  of  warning  functions. 
Allocate  control  functions  to  devices. 


(4)  Identification  of  related  subsystems  functions 

This  task  block  refers  to  the  interface  between  cockpit  moding  and  subsystems 
specif i cat ion. 

In  all  tasks  performed  during  the  course  of  cockpit  moding  the  associated  subsys¬ 
tems  functions  must  be  identified.  The  requirements  must  be  harmonised  with  the 
capabilities.  This  is  an  interactive  task  throughout  the  design  and  development 
process,  and  is  not  detailed  in  this  paper. 


The  ergonomic  requirements  are  shown  in  Fig.  4  as  influencing  set  of  conditions. 
They  comprise  ergonomie  data,  knowledge,  rules,  standards,  and  specifications  appli¬ 
cable  in  the  course  of  cockpit  moding,  which  is  only  part  of  the  total  SOW  task  block 
of  Man-Machine-Interface  Engineering. 


The  allocation  of  information  packages  to  the  display  surfaces  is  entitled 
"Operational  convention/agreement"  in  Fig.  4.  The  reason  therefore  is:  The  requirements 
for  allocating  information  packages  to  areas  in  the  cockpit  is  not  a  specification  item 
for  sub  systems.  It  is  an  operational  requirement,  to  be  established  within  the  systems 
engineering  process  in  direct  cooperation  with  the  user  community,  i.  e.  the  pilots/ 
aircrews . 


To  perform  this  task  we  used  the  following  approach: 


a)  Develop  a  draft  moding  proposal  based  on  data  collected  with  the  operational 
requirements  assessments  (para.  2): 


Information  elements  availability  time  requirement 

Information  elements  assigned  to  task  groups  (Flight  Control,  Navigation 
etc.  ) 

Evaluation  of  information  requirements  for  mission  phases 


b)  Assessment  of  the  draft  moding  proposal  in  a  group  exercise  with  experienced 
user  pilots  -  same  group  and  procedure  as  described  in  para  2-(3). 


In  both  steps,  the  development  and  the  assessment  of  the  draft  proposal,  informa¬ 
tion  from  previous  and  contemporary  aircraft  cockpits  as  well  as  from  recent  simulation 
experiments  was  taken  into  account. 


The  results  of  this  exercise  are  the  operational  agreement  of  the  basic  modina 
requirements.  A  generalised  example  is  presented  here  to  illustrate  the  information 
load  for  the  display  surface  in  the  3  basic  hierarchy  levels  of  the  moding. 


The  table  (Fig.  5)  lists  the  number  of  information  elements  (parameters)  of  the 
various  information  groups  allocated  to  the  display  surfaces  in  the  mission  phase: 
Combat -"WR . 


The  information  element  groups  used  are  the  same  as  detailed  in  Fig.  1. 


I  I- 


In  other  mission  phases  the  allocation  is  considerably  different.  However,  the 
relation  between  display  and  primary  task  resp.  information  allocation  is  kept  con¬ 
stant.  This  is  because  a  high  consistency  is  required  for  the  information  allocation  to 
displays . 


The  pilot  must  not  be  confronted  with  unmotivated  changes  of  display  contents  or 
with  specific  information  being  displayed  at  different  positions  in  different  mission 
phases . 


In  general  the  information  allocation  in  the  BVR  mode  of  the  combat  phase  shows 
the  following: 


BVR  is  a  headdown  operation,  and  there  is  no  SEN  or  weapon  STA  information  displayed 
in  the  HUD. 

The  default  level  has  high  priority.  Only  the  Right  MFD  allows  certain  switching  to 
level  1  and  2. 

The  HUD  is  used  as  the  primay  flight  instrument. 

The  Left  MFD  is  the  primary  sensor  and  attack  display. 

-  The  Center  MFD  is  the  primary  tactical  management  display. 

The  Right  MFD  is  used  as  multi-purpose  display. 


With  the  completion  of  this  exercise  the  information  allocation  is  sufficiently 
defined  as  far  as  the  operational  requirements  are  concerned. 


Further  definitions  into  a  greater  level  of  detail,  and  down  to  the  subsystems 
functions  level  are  subject  to  close  coordination  between  the  cockpit  ai.d  the  subsys¬ 
tems  specialists. 


Fig.  4  contains  other  task  blocks  we  have  not  dealt  with  in  this  paper.  These 

are: 


Moding  definition 

Allocation  of  control  functions  to  devices 
Warning  categories  and  moding 
Subsystems  functions  identification. 


The  description  thereof  can  not  be  included  here. 


These  tasks  are  so  far  performed  in  a  more  heuristic  approach.  And  there  is  no 
other  way. 


Further  research  is  required  to  develop  a 
a  tool  guiding  the  systems  engineer  through  the 


systematic  method, 
process  of  cockpit 


which  can  be  used  as 
mod ing  . 


Glossary 


A/A  Air-to-Air 

A/G  Ai r-to-Ground 

C3I  Command-Control -Communication- Intelligence 

CMFD  Center  Multi  Function  Display 

DASS  Defensive  Aids  Sub-System 

GCP  Guidance  and  Control  Panel 

HUD  Head-up  Display 

IFF  Identification  Friend  Foe 

JTIDS  Joint  Tactical  Information  Distribution  System 

LMFD  Left  Multi  Function  Display 

POI  Point  of  Interest 

RMFD  Right  Multi  Function  Display 

RWR  Radar  Warning  Receiver 

SIP  Selective  Identification  Feature 
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FLT  Flignt  Reference  Information 

SEN  Sensor  Information 

■  A/A  Radar 

■  FUR 

■  Target  (Range.  Bearing.  Altitude) 

TAC  Overall  Situation  Information 

■  Tactical  Information 

■  RWR 

■  JTIDS/DASS 

•  Threat  Assessment 

NAV  Horizontal  Situation  Information 

■  Navigation 

■  Mission  Times 

■  Route  and  POIs 

■  A/G  Radar  (Mapping) 

■  Map 

COM  Communication 

■  Frequencies.  Codes.  Channels 

■  IFF/SIF  Codes 
m  Authentication 

■  Clearances 


STA  Status  Information 

■  ENGINE  (ENG) 

■  Fuel  Management 

»  Systems  (Elect..  Hydr.  etc.) 

■  Configuration  (War  Load) 

■  Weapons 

■  Check  Lists.  Test 
DAT  Data 

■  Comms  List 

■  Charts  (Appr..  Alternates) 

■  POIs  List 

■  Callsign 

Authentication  Format 

■  Arming  Area.  Barrier  etc 
•  Flight  Position 

WNG  Warning 


Fig.  1  Information  Classification  for  Display  Moding 


Fig.  2  Deriving  Operational  Requirements 
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Fig.  3  Example  of  Deriving  Operational  Requirement 

a)  Assessment  of  Information  Elements 
for  Access  Time  Requirement 
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Fig.  3  Continued: 

b)  Assessment  of  Task  Demand  Types 
and  Levels  of  Automation 


Mission:  Air-to-Air 
Phase:  Combat-Medium  Range 
Segments  identified  :  5 
Tasks  identified :  42 


Operational  Requirements  Moding  Definition  Moding  Definition 
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Number  of  information  Elements  per  Information  Group 
Allocated  to  Displays 
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SUMMARY 


Continuous  improvements  in  capabilities  of  military  aircrafts  require  sofisticated 
navigation,  communication  and  weapon  systems.  In  the  mean  time  pilots  require  to  inter- 
c  with  these  systems  by  using  data  entry  facilities  or  synthetic  data  displays.  Con¬ 
trol  panels  using  traditional  push-buttons  with  fixed  legend  cannot  be  enough  flexible 
to  meet  these  new  requirements.  This  paper  presents  an  original  solution  to  control  the 
systems  through  an  integrated  alphanumeric  keyboard  facility  using  custom  push-button 
matrix  with  programmable  LED  display  legend.  Design  and  development  activities  have  been 
carried  out  by  the  authors  and  two  equipments  named  LEFT  and  RIGHT  GLARE  SHIELDS  are  now 
operational  on  the  EAP  demonstrator. 


INTRODUCTION 


Cockpits  of  modern  combact  aircrafts  are  requiring  many  new  man-machine  interface  in 
order  to  program  and  control  systems  and  visualize  synthetic  information.  Interactions 
between  the  pilot  and  these  input/output  systems  need  to  meet  requirements  such  as  very 
limited  space  environments,  HOTAS  operations  compatibility,  enhanced  capability  in  recon¬ 
figure  the  input/output  functions  and  friendly  interface  with  the  crew. 

As  an  answer  to  the  above  general  requirement  AERITALIA  Avionics  Systems  and  Equipment 
Group  Las  developed,  in  collaboration  with  BAE  Warton,  two  equipments  named  GLARE  SHIELDS 
presently  in  use  on  the  EAP  prototype. 

In  general,  the  GLARE  SHIELD  is  a  shaped  head-up  mounted  metal  structure  used  to  avoid 
the  lost  of  contrast  in  the  cockpit  instruments  due  to  incident  sunlight. 

In  the  EAP  this  feature  still  exist  but  the  GLARE  SHIELD  mechanical  structure  contains  a 
complete  programmable  data  entry  facility  with  sunlight  readable  alphanumeric  display. 


OPERATIONAL  DESCRIPTION 


The  main  task  of  the  GLARE  SHIELD  is  to  provide  the  Manual  Data  Entry  Facility  , ML  EE 
a  mean  whereby  system  data  and  information  can  be  typed-in,  selected,  displayed  and  upda¬ 
ted  using  one  common  centralized  and  integrated  device. 

It  fulfils  the  data  entry  functions  of  several  dedicated  units  found  on  conventional  air¬ 
craft  allowing,  in  the  EAP  application,  data  entry  to 

the  Inertial  Nav i ga t i on  Un it  (I NU ) 

-  the  TACAN 

the  Communications  Sub-system. 

The  MDEF  takes  on  different  functions  by  operating  in  'Level*''.  At.  the  top  level  0.  five 
multi-function  Sub-system  Moding  Keys  ISSMKsl  are  available  to  allow  re-mod ing  to  level  1 
wherp  data  can  be  entered  to  the  above  sub-systems. 

Alphanumerical  data  are  inserted  by  using  Data  Entry  Keys  (DEKs)  and  displayed  on  two 
Read  Out  Lines  (ROI.s).  The  concept  allows  for  many  levels,  but  only  two  are  used  on  the 
EAP . 

Some  control  functions  are  carried  out  by  using  dedicated  controls,  i  . «? .  ;omms  -.har.r.e  1  .>• 
lection  and  change  destination. 

The  MDEF  functions  are  implemented  in  two  similar  units,  named  LEFT  HAND  GLARE  SHIELD 
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l LUGS)  and  RIGHT  HAND  GLARE  SHIELD  ( RHGS ) ,  mounted  in  the  upper  part  of  cockpit  'fig.  1 
and  connected  to  the  Cockpit  Interface  Units  (CIFU)  thrcught  a  dedicated  dual  redundant 
L653  Serial  Data  Bus  (fig.  2)  used  to  send  pilot  demand  data  and  to  receive  display  and 
moding  data  to  be  transmitted  or  received  by  the  relevant  sub-systems  on  the  Avionic  Da- 
U  Bus  (CAMS,  INU,  TACAN). 

The  LHGS  (fig.  3)  contains  controls  and  displays.  Controls  consist  of: 

Eleven  System/Sub-system  Moding  Keys  (SSMKs)  used  to  select  the  required  opera, '  ns 
The  Data  Entry  Keyboard  (DEK  board)  used  for  data  insertion 

A  dedicated  communication  channel  selector  (including  present/manual  mode  selector) 
Dedicated  ed1’ ting  keys  as  ENT  (enter)  and  CLR  (clear) 

The  three-position  centre  biased  toggle  switch  for  cursor  positioning 
and  displays  are: 

Dedicated  Set  and  Destination  Waypoint  displays  (SWP  and  DWPi 
Two  Read  Out  Lines  (ROLs). 

The  RHGS  contains  three  display  areas  where  are  shown  communications  selected  channel  and 
frequency,  the  selected  communicat ion  mode  and  TACAN  selected  channel,  beacon  mode  and 
operating  mode.  The  MDEF  allows  data  to  be  entered  to  Navigation  (rnerMal  Navigation 
Unit  and  Radio  Navigation  Aids)  and  Communications  (Main  Radio)  sub-systems. 

The  navigation  data  to  be  entered  are: 

Set  Waypoint  (SWP)  number 

Latitude  and  longitude  against  Set  Waypoint  number 
Alignment  latitude,  longitude  and  true  heading 
Time  (hours,  minutes,  seconds) 

TACAN  channel 

TACAN  operating  mode  (receive  only  or  transmi t / receive ) 

TACAN  beacon  mode  (X  or  Y). 

T n  addition,  position  fixing  errors  are  displayed  and  accepted  or  reject?- j  via  the  MI  FF. 


The  Comms  data  to  be  entered  are: 


Receiver  mode  I. Transmit  or  Transmit  ~  Guard) 
Narrow  or  broad  bandwidth 


Operating  channe 1 / f requenrv  entry 
Manual  or  present  mode  selection. 

As  above  mentioned.  LHGS  and  RHGS  are  software  programmed  to  opera 
This  feature  takes  advantage  from  the  capability  of  the  SSMKs  and 
l .'.gr-nch-  and  associate  functions  under  software  control  in  response 
A*  the  top  level  (level  Oj  SSMKs  labels  and  functions  a r** : 


T  I  ME  -  \<)  initial!  so  ssy  stem  *i  me 

AI.Gfl  DATA  -  ’a  allow  entry  >.  f  a  1  :  *  data  *  .  Mie  Inertial  Navi 

|VjMM  -  to  allow  'iperoMng  data  be  .*r.t  1  *  o  the  V'-'h.-  ra 

SWP  -  aJ  1>.)W  ri.av  i  gat.  i->t;  w  !/;  ■>(:.  t.  Ja*  a  *  ■  !:•••  **  r  i  *  *-•  '  *  i  i 

o'N  -  •  o  a  i  1  ■  'W  -..pora*  in,.' 


•  h-- 
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The  cv>mb ined  use  of  programmable  legends,  dedicated  display  areas,  cursor  marker,  edit,  ing 
functions  as  clear,  enter  and  restart  allow  flexibility  and  friendly  interface  with  the 
operator. 

As  an  example  the  COMMUNICATION  mode  data  entry  facilities  are  presented. 

After  the  power-up,  at  the  completion  of  the  BIT  procedure,  the  LHGS  presents  the  level  0 
display  (fig.  5). 

By  pressing  the  SSMK  with  the  legend  'COMM' ,  the  level  1  communication  data  entry  facili¬ 
ties  are  selec-ed  and  the  LHGS  display  layout  is  presented  to  the  operator  (fig.  b) . 

When  in  COMM  level  1,  three  data  entry  submode  are  available,  the  Destination  arid  Set  Way 
point  display  remain  as  previously  programmed,  the  Change  Destination  ’CHD'  switch  is 
software  disabled,  the  ROL  I  visualizes  the  word  'MANUAL'  to  indicate  that  the  manual  f re 
queney  change  mode  is  selected  and  ROL  2  shows  the  previously  stored  manual  frequency. 

The  Data  Entry  Keyboard  becomes  operative  showing  digits,  clear  and  enter  labelled  keys 
allowing  the  operator  to  enter  a  new  manual  frequency  by  typing  in  the  desired  entire  va¬ 
lue  . 

If  only  partial  correction  of  the  actual  value  is  desired  the  marker  has  to  be  positioned 
under  the  uncorrect  digit  by  operating  the  cursor  toggle  switch  and  by  pressing  the  new 
digit.  When  the  switch  labelled  *ENT’  is  pressed  the  frequency  value  displayed  by  ROL  2 
becomes  immediately  operative  only  if  the  manual  mode  is  also  selected  on  the  communica¬ 
tion  control  switch.  Otherwise  the  new  manual  frequency  is  stored  and  becomes  operative 
whenever  the  manual  mode  on  the  CCS  is  selected. 

The  three  available  SSMKs  on  the  top  of  the  LHGS  are  programmed  to  act  as  momentary  swit¬ 
ches  with  toggle  labels.  They  are  used  to  select  the  optional  mode  of  operation  available 
and  the  current  operative  option  is  displayed  with  the  appropriate  mnemonic  legend. 

At  any  time  it  is  possible  to  leave  the  actual  data  entry  procedure  to  return  to  the  main 
menu  (level  0).  by  pressing  the  SSMK  marked  ’COMM  RST ’ . 


MECHANICAL  DESIGN 


The  equipment  is  fitted  on  and  forms  the  upper  part  of  the  cockpit. 

Its  external  profile  defines  the  maximum  viewing  angle  of  the  pilot  and  costitutes  the 
cover  for  the  cockpit  with  anti-glare  function  while  at  the  bottom  the  shape  is  limited 
by  the  shape  of  other  equipments. 

The  GLARE  SHIELDS  are  Line  Replaceable  Units,  fixed  on  the  aircraft  structure  by  bolts 
and  hinged  to  the  central  create  in  order  to  swing  and  to  allow  replacement  of  other  cock 
pit.  equipment  without  requiring  their  disassembly. 

The  front;  shape  of  the  units  looks  like  two  triangles  joined  at  a  corner,  and  the  left 
unit  is  approximately  the  mirror  image  of  the  right  unit. 

On  both  units  the  upper  part  contains  the  power  supply  module,  a  front  panel  -and  the  main 
connectors  on  the  rear  while  the  lower  part  contains  the  electronic  modules  and  another 
front  panel. 

The  two  front  panels  of  LHGS  carry  push-button  matrix  with  programmable  legends:  on  the 
upper  panel  are  located  the  System/Sub-r.ystem  Moding  Keys  (SSMK)  and  on  the  lower  panel 
are  located  the  Data  Entry  Keys  i DEK ) . 

The  mechanical  design  was  carried  out  also  taking  into  the  account  maintainability  aspect 
The  electronic  circuitry  is  splitted  into  throe  plug-in  cards  connected  together  by  means 
of  a  motherboard  and  front  panels  are  interfaced  with  the  wiring  harness  by  means  of  con¬ 
nectors  iri  order  to  allow  their  replacement  without  removing  the  GLARE  SHIELDS  from  the 
a i re raf  t . 

The  plug-in  cards  arid  motherboard  are  supported  by  a  metal  frame  with  fir.s  on  the  exter¬ 
nal  side  and  guides  for  cards  on  the  opposite  side. 

On  the  bottom  surface  of  the  upper  para  of  the  case  a  flood  light  is  installed  for  night 
flight.  The  flood  l!  .  is  a  custom  electroluminescent  device  plug-in  mounted  with  a 
thickness  of  2  mil  .  ters. 

The  metal  structure  of  the  case  is  obtained  by  aluminium  alloy  investment  casting.  This 
technology  was  selected  because  is  allows  to  realize  the  complicate  shape,  due  to  the  in¬ 
stallation  requirements,  leaving  the  maximum  possible  internal  space  and  furthermore  it 
assures  the  necessary  strenght  in  the  critical  area:  the  joining  point  between  the  trian¬ 
gles.  The  material  used  for  the  casting  assures  also  a  good  thermal  dissipation  and  redu¬ 
ces  manufacturing  time  and  cost. 

Each  case  after  cast  rig  process  is  checked  with  penetrant,  fluid  and  x-rays  to  prevent 
cracks  and  the  dimensions  are  controlled  to  guarantee  mechanical  tolerances. 

The  GLARE  SHIELDS  do  not  require  forced  air  ventilation. 

The  thermal  management  of  the  GLARE  SHIELD  is  performed  by  conducting  the  heat  flow  to 
the  main  frame  of  the  equipment. 

The  main  areas  of  heat  generation  are  localized  on  the  electronic  modules,  power  supply 
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and  displays. 

The  thermal  dissipation  of  the  electronic  modules  is  assured  by  means  of  heat  sink  bonded 
on  PCBs  joined  to  the  finned  metal  frame  by  metal  clamps,  the  power  supply  layout  is  des_i 
gned  to  have  the  high  power  devices  placed  on  a  large  finned  plate  to  form  an  external 
wall  of  the  unit  and  the  LED  displays  dissipation  is  carried  out  by  means  of  heatsink  and 
front  panel  surface. 


PROGRAMMABLE  PUSH-BUTTON  DESIGN 


Many  features  of  the  MDEF  are  achieved  by  using  a  new  developed  push-button  assembly 
that  combines  the  typing  performances  of  a  true  push-button  with  the  flexibility  of  a  LED 
display  used  for  the  legend. 

Design  problems  were  mainly  in  the  combination  of  these  two  requirements  that  have  impact 
on  the  mechanical  design  of  the  push-button  by  minimizing  the  size,  the  number  of  moving 
parts  and  the  thermal  management  of  the  item. 

Fig.  6  shows  an  exploded  view  of  the  legend  programmable  push-button. 

It  consists  of  a  miniature  switch  module  containing  the  momentary  single  pole  contact  and 
the  mechanical  parts  to  provide  the  correct  actuation  travel  and  force. 

The  moving  part  of  the  switch  is  shaped  as  two  fins  providing  the  interface  with  the  front 
cap  of  the  push-button  and  are  designed  to  pass  through  the  printed  circuit  board,  by  the 
side  of  the  display  package  to  the  filter  acting  as  a  contrast  enhancer  media  and  moving 
cap.  The  multilayer  PCB  connects  the  switches  and  the  display  packages  to  the  electronic 
modules  and  acts  also  as  a  mechanical  support  for  the  switch  module  on  the  back  and  the 
LED  display  package  and  the  relevant  heat  sink  on  the  top. 

The  front  panel  covers  the  switch  assembly,  acts  as  a  guide  and  retainer  for  the  filter 
and  provides  the  mechanical  separation  between  switches. 

The  displays  selected  to  realize  the  programmable  legend  in  the  push-button  assembly  are 
a  sunlight  readable  version  of  the  high  performance  green  four  characters  5  by  7  dot  ma¬ 
trix  alphanumeric  display  HP-2303. 

Each  four  character  cluster  is  contained  in  a  12  pin  dual-in-line  package  with  front  glass 
window. 

The  light  emitting  diode  array  produces  an  alphanumeric  character  5  millimeters  high  and 
is  driven  by  an  on-chip  serial  input/parallel  output  shift  register  and  associated  con¬ 
stant  current  LED  driver. 

This  feature  allows  an  easy  interface  between  display  chips  by  connecting  the  shift  regi¬ 
sters  in  serial  mode  and  driving  the  character  array  with  the  clock,  the  serial  signal 
and  the  decoded  column  number. 

The  peak  wavelength  of  the  LED  array  is  570  nanometers,  falling  in  the  greenish-yellow  re 
gion  of  the  CIE  Standard  Observer  Curve. 

This  wavelength  has  been  selected  because  the  emission  of  the  LED  in  the  region  in  which 
the  night  vision  goggle  are  sensitive  is  very  low  (at  645  nm.  the  emission  is  about  three 
hundred  times  lower  than  at  570  nm. )  and  a  complete  night  vision  goggle  compatibility  can 
be  easly  acheived  by  using  of  filters. 


ELECTRONIC  DESIGN 


The  electronic  circuitry  of  the  GLARE  SHIELDS  is  organized  in  four  replaceable  modu¬ 
les  connected  together  through  a  common  motherboard  (fig.  7). 

They  are : 

Processor  Module 

Keyboard  and  Display  Driver  Card 
1553  Remote  Terminal  Card 
Display  Power  Driver  Card 

The  processor  module  contains  all  the  circuitry  related  to  the  computing  facilities  imple 
merited  in  the  GLARE  SHIELDS. 

It  is  designed  around  a  Z8002  1G  bit.  microprocessor  running  at  6  MHz  of  clock  speed  with 
program  and  data  memory  realized  with  an  hybrid  circuit  containing  EPROM  and  RAM. 

To  support  real  time  processing  four  programmable  counters  are  available  ale.  use  i  to  ge 
nerate  master  synchronism  for  the  display  controller  module. 

The  processor  module  contains  also  circuitry  to  access  to  the  other  cards  as  ph^ripner  il s 


via  a  buffered  address ,  data  ana  control  lines  and  facilities  •  supper*  r-.-’t.  ■  *  : u  «. 

ar.  :i  \  r.  t  e  r  r  up  t  i  v o  i,  u  i 1 t  -  i  r.  test. 

The  lisp  lay  eon?  roller*  module  generates  all  the  T  iruing  rejuiiv  J  to  i  r  i  v»  •  tn-  '..K'  ■  i :  :  .ays 
and  :o  scan  the  switches  matrix.  The  processor  can  access,  the  display  c-.-:.  •  ro  1  1  t-r  .is  a  j.  h^ 
ripheral  to  read  status  informations  and  keyboard  data. 

The  coni  i-ui  ier  is  organized  as  a  state  machine  tha»  in  sequence  reads  from  a  d-d  i  cat  rr;- 
tnroy  the  data  t  •  be  displayed,  serializes  and  sends  them  with  the  -'lock  t  *  he  if.-pr-  pr;u- 
te  display  array.  To  avo  i  ti  flickerring,  1  he  displays  are  organized  in  four  ini :  pen  lent 
rial  .arrays  of  eleven  displays  each  connected  with  common  columns  lines. 

The  data  to  be  serialized  are  collected  from  the  display  data  men.  ry  that  car.  a  1  so  f-  j  . 
cessed  by  the  processor  and  is  software  organized  in  dedicated  locations  for  each  display 

with  data  already  converted  with  the  appropriate  font  from  AS  a  f  1  cod-.-  •  :  •.  no  display  f  .  r- 

mat  ready  ro  be  serialized. 

The  module  contains  also  the  circuit  to  control  the  brightness  of  the  LED  array  by  r - 

vir.g  the  centralized  brightness  control  signals  and  converting  them  intc  vami  :  r.  •  f 

the  width  of  the  column  pulses  that  are  generated  by  the  display  controller  card  in:  suf¬ 
fered  by  the  display  power  driver  card. 

In  a  separate  module  a  complete  1553B  dual  redundant  Remote  Terminal  Unit  i:-;  imp  1  i.em.c. ■  -  : 
with  the  adoption  of  an  hybrid  circuit  that  integrate  the  functions  of  protocol  '  r  .  1- 
ler.  serial  transmitter  and  receiver  and  line  amplifiers.  Data  words  received  and  tran¬ 
smitted  are  placed  in  a  dedicated  memory  area  in  the  processor  f-oarl  and  ar  -  t  rar.sf-r**  : 
to  the  lSS"*  module  in  DMA  mode.  Mode  codes  and  subadur--.es  jut  a  field  ar*--  air.  i 
The  error  conditions  are  handled  by  the  processor  advised  with  dedicated  ;u*~:tu:* 
and  status  words. 

The  switching  mode  power  supply  generates  from  a  lib  Volts  4ju  Hertz  inpjt  ,  1  •  . 

to  be  '.iF°d  in  the  different  modules:  b  VDC  for  the  logi  •  circuitry,  the  *:vi  ar.  n 

gat  ive  IS  VDC  for  the  1SSJ  interfaces  and  the  S  VDC  high,  .urr-:u  u*iu*  f  jr  the  1  .,v 

array . 
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CONCLUSIONS 


The  GLARE  SHIELDS  wore  successful  ly  »?.;•*  eu  during  tf-  fligr.*  • rials  : 
to  type.  Reports.  from  the  pilots  gave  us  the  f ;  :ion  ?~  ?hut  *.h~  main 
filled  by  confirming  the  improvement  :  r'  the  ope  rat  i  ena  1  capafc- :  1  i  -  :  •  *.? 

The  Avionics  System  and  Equipment  up  ef  A~  r it aL in  n;  :\v.x  \  v.g 

t.  i  c in  :rder  to  met-:  new  requi  r-mt-nt  s  arid  *.o  ;  :v r-'  i -'•*  th->  ; .>-rr  :  r. a i  c  a: 
t  hi.-  ctit-.-gury  of  equipment  with  *  he  u:;*>  of  n-w  1  og:  es  as  *rist  •» 

in  replacemen*  of  the  LED  displays. 

Despite  .heir  problems  to  the  extreme  temp^ra^ur-  rang**,  :•*!  f :  *-rz  fact 
m  terms  of  thermal  iissipat  ion,  reliability  at.  i  c ;  r.-ui  •  ::m.pl-xi‘v  w:*h  >.-i 
nal  capabilities  due  to  tno  easy  cus*  '-mi  zaf  ion  cf  such  J.-vi  •••.:  ; : .  •*-:-.•  ■  f  z 
tat  ion. 
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SUMMARY  A  real-tirae,  pilot  interactive  demonstration  and  test  of  a  large  area  fighter 
cockpit  display  has  been  conducted.  The  test  of  this  large  area  (38cm  X  51cm) ,  full 
color  display  was  conducted  in  a  mock-up  cockpit  at  the  McDonnell  Aircraft  simulation 
facility.  This  display  used  essentially  the  entire  instrument  panel  area  to  present  a 
moving  map  with  symbology  and  other  information  overlain  and  also  presented  sensor 
imagery  and  other  information  as  required.  The  information  presented  could  be 
customized  for  a  particular  mission  phase  or  other  need.  A  touch  sensitive  display  as 
well  as  other  advanced  control  concepts  were  also  demonstrated  in  conjunction  with  the 
large  area  display.  This  display  and  control  concept  simplifies  and  automates  many  of 
the  control  and  display  functions  for  the  pilot  of  an  advanced  fighter  aircraft.  The 
results  of  demonstration  and  testing  with  ten  pilots  will  be  presented. 


INTRODUCTION 

Poor  "situation  awareness"  is  the  area  cited  by  aircrews  as  the  primary 
deficiency  of  present  day  fighter  aircraft.  The  information  that  the  aircrews  need  to 
know  is:  (1)  their  location;  (2)  the  location,  type  and  capability  of  the  friendly 
forces;  (3)  the  location,  type  and  capability  of  the  targets  and  (4)  the  location  of 
all  threats  and  their  associated  lethality.  Moreover,  we  feel  this  information  needs 
to  be  fused,  integrated  and  controllable  in  a  single  color  display  for  easy 
understanding.  Most  of  the  above  information  is  presented  in  todays  aircraft,  in 
various  display  formats  and  to  various  scales,  on  discrete  displays  located  throughout, 
the  cockp-'t.  The  crew  must  mentally  fuse  these  various  sources  of  information  to 
obtain  a  picture  of  the  total  situation. 

A  number  of  new  display  concepts  aimed  at  improving  situation  awareness  and 
simplifying  the  aircrew  tasks  can  only  be  implemented  properly  using  a  larger,  more 
flexible  and  controllable  color  display  area.  In  this  context,  "large  area"  is  meant 
to  imply  a  display  area  of  at  least  1200  sq.  centimeters  viewing  area.  Flight-worthy 
color  display  technology  does  not  exist,  neither  direct  view  or  projection,  flat 
panels  or  cathode  ray  tubes  (CRT) ,  to  provide  such  a  large  area  cockpit  display  in 
high  brightness,  high  resolution,  and  full  color.  However,  existing  display 
technology  is  adequate  to  build  a  cockpit  simulator  (ground  based)  version  of  PCCADS, 
where  packaging,  volume,  and  environmental  limitations  are  less  constraining. 

The  PCCADS  proqram  evaluated  (with  ground  based  equipment)  the  benefits  of  a 
large  area  color  display  and  advanced  control  concepts  which  are  unconstrained  by  the 
information  placement  and  formatting  afforded  by  today's  small  area  cockpit  CRT 
displays.  This  PCCADS  evaluation  is  the  first  step  in  pursuit  of  the  cockpit 
technology  which  will  replace  today's  limited  capability  by  a  large  area  display 
having  flexible  formatting  and  information  placement  capability.  PCCADS  allows  custom 
formatting  of  displays  to  provide  the  most  appropriate  use  of  the  instrument  panel 
surface  during  each  mission  segment.  Advanced  PCCADS  touch  panel,  helmet  mounted 
sight  and  voice  control  devices  were  used  along  with  the  PCCADS  large  area  color 
display  to  demonstrate  a  simplification  of  the  pilot's  task  and  provide  a  more 
effective  pilot/aircraft  interface  and  weapon  system. 

BACKGROUND:  In  recent  years,  fighter  aircraft  and  missions  have  been  growing  more 

complex  and  difficult.  for  the  past  two  decades  the  growing  problem  of  system  control 
has  been  approached  by  simply  adding  displays  and  controls  to  the  crew  station.  This 
process  has  continued  to  the  point  where  the  large  number  of  controls  has  very  nearly 
become  unmanageable  by  the  aircrew.  Simultaneously,  display  area  for  sensors  has 
decreased.  For  instance,  the  F-111A  (1960)  radar  has  an  18  centimeter  diameter  radar 
display.  The  F-16A  (1980)  now  has  a  10  centimeter  square  radar  display  which  must  be 
shared  with  control  functions.  In  essence,  multi-million  dollar  sensors  are  now  being 
interfaced  with  the  aircrew  through  miniature,  time  shared  displays.  This  problem  is 
now  being  addressed  by  creative  thinking,  less  constrained  by  existing  technology,  and 
by  a  consideration  of  both  the  information  displayed  and  the  control  techniques  in 
relation  to  the  capabilities  of  the  pilot.  Prior  to  the  PCCADS  program  a  study 
entitled  "Display  Techniques  for  Advanced  Crew  Stations"  was  completed.  The  study 
explored  advanced  control  and  display  techniques  and  their  effect  on  future 
fighter/attack  aircraft  crew  stations.  The  emphasis  was  on  new  and  developing 
technology  with  innovative  applications  to  integrated  avionics  systems.  The  study 
reviewed  anticipated  future  mission  requirements,  established  display  requirements  and 
reviewed  display  technologies  as  well  as  information  placement,  formatting  and  use. 


SITUATION  AWARENESS 


To  be  successful  in  air  combat,  the  tactical  fighter  pilot  must  establish 
situation  awareness  at  the  start  of  each  mission,  then  maintain  it  throughout  the 
mission.  Pilots  continually  state  the  importance  of  situation  awareness,  and  recent 
studies  indicate  it  is  the  decisive  factor  in  determining  the  victor  in  air  combat. 
Defining  "situation  awareness"  is  not  simple.  This  study  has  chosen  to  adopt  the 
Tactical  Air  Command  definition  as  set  forth  in  the  final  report  of  the  Intraflight 
Command  Control,  and  Communications  Symposium.  It  states  that  situation  awareness 
consists  of  the  following  elements: 

(1)  Knowing  where  the  friendlies  are  and  what  they  are  doing. 

(2)  Knowing  where  the  threats  are  and  what  they  are  doing. 

(3)  Knowing  what  my  flight  knows  and  what  our  options  are  for  of fense/deccnse. 

(4)  Knowing  what  other  flights  know  and  what  their  intentions  are. 

(5)  Knowing  what  part  of  the  above  is  not  known  or  is  missing. 

Current  cockpit  display  systems  present  problems  in  gaining  and  maintaining 
situation  awareness.  This  is  because  of  the  evolution  of  fighter  aircraft  from  simple 
aircraft  with  guns  mounted  on  them  to  jet  aircraft  possessing  an  airborne  radar 
system,  and  ultimately,  to  the  present  generation  of  advanced  fighters  containing  a 
multitude  of  sensors  for  detecting  both  ground  and  air  targets,  detecting  threats, 
navigating  and  maintaining  communication  with  other  aircraft  and  coiomand  and  control 
elements.  The  systems  which  make  use  of  these  sensors  have  been  added  to  fighter 
aircraft  one  at  a  time.  Each  has  brought  to  the  aircraft  its  own  display  formats  and, 
in  many  cases,  its  own  dedicated  display  system.  As  a  result  of  this  evolution, 
present  day  fighter  cockpits  often  provide  the  situation  to  the  pilot  by  means  of 
several  different,  often  dedicated,  displays.  Each  of  these  displays  provides  the 
data  obtained  from  one  type  of  sensor.  Each  of  these  displays  uses  its  own  unique 
format,  and  often  each  is  set  to  a  different  range  scale.  The  pilot  is  faced  with  the 
problem  of  mentally  fusing  the  data  provided  by  these  dit cerent  displays  into  a  single 
mental  picture  of  the  tactical  situation.  Because  it  takes  time  to  do  this,  gaining 
situation  awareness  is  difficult?  maintaining  it  in  the  "heat  of  battle"  is  nearly 
impossible . 

A  sample  fusion  problem  is  shown  in  Figure  1.  Radar  information,  displayed  on  a 
B-scope,  must  bo  interpreted,  then  correlated  with  the  data  from  navigation  (NAV) , 
electronic  warfare  {EW) ,  and  Joint  Tactical  Information  Distribution  System  (JTIDS) 


Pilot  spends  Much  Time 

•  Manipulating  Data  Displays  and  Systems  (Piddling  and  Flying) 

•  Assimilating  and  Correlating  Data  trom  Modes  He  s  m 

•  Wondering  About  Oata  m  Modes  He's  Not  m 
(Pear  of  Assassination) 
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Figure  1.  Example  Intormation  Fusion  Problem 
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displays.  At  a  minimum,  the  B-scope  radar  format  will  differ  from  the  other  three, 
which  normally  employ  a  360  degree  planform  format.  Normally,  each  of  the  four 
displays  will  be  set  to  different  range  scales.  This  problem  is  further  complicated 
by  the  fact  that  some  targets  will  show  up  on  all  displays,  occupying  slightly 
different  positions  as  a  result  of  the  different  formats  in  use.  These  must  be 
recognized  as  being  different  depictions  of  a  single  physical  object.  Conversely, 
some  items  may  show  up  on  only  one  display,  and  must  be  recognized  as  unique  elements 
of  the  situation.  Thus,  as  part  of  the  overall  fusion  problem,  the  pilot  must 
determine  similarities  and  differences  in  the  various  displays  in  order  to  accurately 
assess  the  situation.  As  technological  advances  continue,  these  problems  will 
continue  to  grow  in  magnitude. 

PCCADS/BIG  PICTURE  SOLUTION 

One  solution  to  this  problem  is  to  integrate  the  available  data  and  then  provide 
all  information  relevant  to  the  situation  on  a  single  display.  However,  the  display 
must  be  large  enough  to  display  this  data  without  becoming  to  cluttered.  Currently, 
cockpit  CRT  displays  provide  only  150  -  250  sq.  centimeters  of  display  surface.  If 
radar,  JTIDS,  EW,  and  NAV  data  are  all  displayed  simultaneously  in  this  small  area, 
the  resulting  display  will  be  too  cluttered  in  all  but  the  most  simple  situations.  To 
present  a  complex  situation  without  excessive  clutter,  the  overall  display  area  must 
be  increased. 

The  main  goal  of  this  study  was  to  evaluate  the  improvements  to  situation 
awareness  that  could  be  obtained  by  the  use  of  a  single,  large  area,  color  display.  A 
single  display  is  required  to  fuse  all  sensor  data  into  a  single  picture  of  the 
tactical  situation,  with  all  elements  plotted  on  a  single  format  and  using  the  same 
scale.  A  large  scale  is  required  to  handle  the  clutter  problem;  consequently,  a 
<ii»pld/  area  cf  190C  cq.  centime tors  was  employed,  «,,d  the  display  occupied 
essentially  the  entire  instrument  panel  of  the  cockpit.  Finally  color  was  used  to 
encode  some  of  the  information,  so  that  certain  aspects  of  the  situation  could  be  ♦seen 
at  a  glance  by  the  pilot  (e.g.  hostile  vs.  friendly  aircraft). 

Another  aspect  of  the  problem  to  be  investigated  was  pilot  interaction  with  the 
aircraft.  As  pointed  out  previously,  the  pilot  must  presently  expend  a  great  deal  of 
time  and  effort  in  direct  control  and  coordination  of  on-board  sensor  modes  and 
displays.  Several  improvements  are  possible  in  this  area.  First,  to  accomplish  a 
certain  task,  all  onboard  sensors  are  simultaneously  directed  to  obtain  the  necessary 
information.  Second,  several  aspects  of  sensor  control  can  be  automated  to  tha4- 
selection  of  an  operating  mode  for  the  system  will  automatically  place  all  sensors  in 
the  optimum  modes  and  parameters  for  the  task  at  hand.  While  override  modes  may  be 
required  to  handle  special  situations,  the  more  common  situations  can  be  automated  so 
that  less  pilot  effort  is  required.  This  frees  the  pilot  to  concentrate  on  tactics 
instead  of  sensor  selection  and  operation. 

Unfortunately  the  display  technology  does  not  currently  exist  to  provide  a  large 
area  display  with  sufficient  brightness  and  resolution  in  an  acutal  aircraft. 

However,  a  large  area  display  with  sufficient  brightness  and  resolution  could  be 
provided  in  a  simulator  to  demonstrate  and  test  the  value  of  such  a  display.  In 
addition  to  the  large  display  and  the  integration  and  automation  of  sensor  operation 
mentioned  above,  we  wished  to  demonstrate  the  value  of  advanced  control  concepts  such 
as  HOTAS  (Hands  on  Throttle  and  Stick),  Touch  Panel,  Automatic  Speech  Recognition,  and 
an  HMS  (Helmet  Mounted  Sight) .  The  HOTAS  control  approach  allows  the  pilot  to  control 
various  functions  and  subsystems  without  removing  his  hands  from  the  stick  or 
throttle.  The  pilot  is  able  to  perform  various  control  operations  by  using  either 
dedicated  switches  or  controls  on  the  stick  and  throttles,  or  by  controlling  a  cursor 
on  the  display  to  select  options  present  on  a  particular  display  format.  The  touch 
panel  uses  an  overlay  grid  of  infrared  beams  which  are  interrupted  at  a  particular 
location  when  the  pilot  touches  the  display.  Using  this  touch  control  he  can 
designate  items  on  the  display,  make  selections  from  menu  items,  draw  routes  and  move 
inset  displays.  Voice  control  is  used  either  alone  to  perform  various  operations  or 
in  conjunction  with  touch  control.  The  use  of  voice  and  touch  simultaneously  allows 
the  pilot  to  designate  an  item  with  touch  and  then  with  voice  have  the  system  perform 
some  action  on  the  display  item  designated.  The  helmet  mounted  sight  may  be  used 
similar  to  touch  to  designate  an  item  on  the  display  or  to  control  a  cursor  on  the 
display. 

PCCADS  SIMULATOR 

The  display  in  the  simulator  cockpit  is  a  38  X  50  centimeter  rear  projection 
screen.  Two  video  projectors  were  used  to  project  onto  the  screen.  One  projector 
provided  the  background  display  which  was  usually  a  moving  map,  while  the  other 
projector  provided  all  of  the  overlay  information  which  included  ownship  position, 
friendly  positions,  positions  of  other  aircraft,  threat  locations,  target  locations, 
route-of-f light ,  and  other  information  as  required  to  perform  various  mission  tasks. 
Insets  in  the  display  formats  could  also  be  provided.  These  insets  included  radar  and 
FLIR  imayery  and  graphic  insets  such  as  weapon  status  and  fuel  status  depicted  in 
pictorial  format.  The  insets  are  always  available,  but  they  are  only  displayed  when 
the  pilot  selects  them.  Once  displayed  they  can  be  enlarged,  reduced,  moved  to  any 
location  on  the  display,  or  completely  removed  from  the  display.  The  intent  is  that 
they  are  used  only  as  needed  by  the  pilot  tc  provide  additional  information.  Figures 
2  to  5  show  typical  display  formats  which  are  in  color  in  the  actual  simulator. 

A  yraphics  system  was  designed  to  generate  the  required  display  elements.  Key 
components  are  the  MIGS  (Map  Image  Generation  System) ,  the  Compuscene,  an  IRIS,  a 
Graphics  Processor,  and  a  projection  system.  A  functional  block  diagram  depicting  the 
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entire  system  is  shown  in  Figure  6  and  key  components  are  described  in  the  following 
paragraphs . 


Figure  6.  PCCADS  Simulator 


Map  Image  Generation  System  (MIGS)  -  The  MIGS  is  a  McAir  developed  system  that 
combines  an  Image  Processor/  a  300  megabyte  real-time  disk,  and  special  image 
generation  circuitry  to  produce  digital  maps.  The  "real-time  disk"  is  a  magnetic, 
fixed  disk  that  is  capable  of  transferring  the  256  kilobytes  required  to  form  one 
frame  of  video  in  33  msec.  Thus,  the  MIGS  is  capable  of  supporting  a  30  hz.  video 
frame  update  rate,  which  gives  the  appearance  of  a  continuous,  real-time  video  image. 
The  MIGS  is  used  to  provide  moving  map  backgrounds  for  the  head-down  display.  Since 
it  is  capable  of  a  30  hz .  update  rate,  it  can  provide  a  map  display  that  moves 
smoothly  and  continuously  as  a  function  of  aircraft  motion.  The  MIGS  is  also  used  to 
provide  Synthetic  Aperture  Radar  (SAP)  imagery  by  inserting  prestored  SAP  frames  into 
the  map  when  required. 

Compuscene  IV  -  Compuscene  is  a  General  Electric  graphics  system  that  is  used 
primarily  to  provide  digitally  generated,  realistic  visual  displays.  This  system  is 
used  primarily  to  provide  the  out-the-window  (OTW)  scene.  However,  Compuscene  can 
provide  up  to  four  independent  channels?  therefore,  one  of  these  channels  is  used  by 
the  head  down  display  to  provide  the  perspective  view  terrain  background  employed  by 
the  terrain  following/terrain  avoidance  (TF/TA)  format.  Compuscene  is  also  used  to 
provide  simulated  FLIR  imagery,  which  is  available  as  an  inset. 

Integrated  Raster  Imaging  System  (IRIS)  -  The  IRIS  is  a  graphics  engine  produced 
by  Silicon  Graphics  Inc.  that  is  capable  of  zoom,  rotations,  scalings,  perspective 
views,  etc.  The  primary  purpose  of  the  IRIS  is  the  production  of  overlay  graphics; 
i.e.  aircraft  symbols,  route  of  flight  lines,  threat  rings,  etc.  The  IRIS  is  also 
used  to  produce  many  of  the  pictorial  format  inserts  that  are  employed. 

PROJECTION  SYSTEM 

The  HDD  projection  system,  including  the  two  projectors,  is  physically  located  in 
the  "nose"  of  the  PCCADS  cockpit  shell.  This  is  shown  in  Figure  7.  All  other 
elements  of  the  HDD  graphics  system  are  physically  remote  from  the  cockpit. 

The  HUD  is  a  projected  display,  the  PCCADS  crew  station  only  simulates  a  HUD. 
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Since  the  PCCADS  cockpit  will  only  be  used  as  an  evaluation  tool,  it  was  decided  to 
project  the  IIUD  displays  on  the  OTW  scene.  This  has  the  advantage  of  allowing  all 
individuals  present  to  view  the  HUD  display,  as  opposed  to  an  actual  HUD  that  can  only 
be  seen  by  the  cockpit  occupant. 

OTW  Projection  fwr  the  main  PCCADS  testing  was  performed  in  a  12  meter  diameter 
dome.  This  provides  a  full  360  degree  visual  display.  Compuscene  is  used  to  produce 
half  of  the  visual  scene,  which  is  projected  onto  the  forward  inside  surface  of  the 
dome,  the  remaining  portion  is  produced  by  a  dynamic  earth/sky  system  which  projects 
simple  low  resolution  imagery  on  the  remainder  of  the  dome. 


Figure  7.  PCCADS  Projection  System 


PCCADS  EVALUATION 

The  PCCADC  crew  station  was  evaluated  in  both  air-to-air  ana  air-to-ground  full 
mission  piloted  simulation. 

Each  pilot  flew  both  the  air-to-air  scenario  and  air-to-ground  scenario  once. 

Each  scenario  was  divided  into  segments  for  the  purpose  of  data  collection. 

The  air-to-air  scenario  was  a  defensive  counter-air  mission.  As  part  of  the  Blue 
Force,  the  participating  pilots  had  the  mission  of  defending  Blue  airfields  from 
attacking  Red  bombers  and  accompanying  fighters.  An  overall  view  of  the  air-to-air 
scenario  is  shown  in  Figure  8.  The  defending  Blue  fighter  encountered  two  waves  of 
four  ingressing  Red  fighters.  It  was  required  to  defeat  both  waves  and  return  to  base 
within  fuel  and  weapons  load  limitations. 

The  air-to-ground  scenario  was  an  air-to-ground  interdiction  mission  as  depicted 
in  Figure  9.  The  participating  pilot  was  lead  in  a  two  ship  flight  directed  to  strike 
an  armored  column  behind  the  FEBA  using  infrared  guided  missiles.  A  second  strike 
employed  CBU  weapons  against  personnel  carriers  designated  by  a  laser-spot  tracker. 
Both  surface  *nd  air  threats  were  encountered  during  the  mission.  Mission  replanning 
was  required  during  ingress  to  minimize  threat  and  maintain  time-on-target.  Air 
threats  and  a  fuel  emergency  were  encountered  after  the  second  strike. 

PROCEDURES 

The  PCCADS  crew  station  was  evaluated  in  80  hours  of  pilotei  simulation  including 
all  major  phases  of  air-to-air  and  air-to-ground  missions.  Extensive  training 
consisting  of  eight  hours  of  "ground  school"  academic  training  and  six  hours  of 
hands-on  familiarization  was  given  to  all  participants.  The  eighty  hours  of 
simulation  were  divided  between  40  hours  of  simulation  in  a  domed  facility  with  a 
complete  360  degree  out-the-window  scene  and  40  hours  of  simulation  with  a  40  degree 
out-of-the  window  scene  (see  Figure  10) .  Air  Force  pilots  participated  only  in  the 
domed  facility.  Performance  data  were  collected  in  real-time  by  the  PCCADS  computer 
system.  Missions  were  divided  into  a  series  of  initial  conditions  at  significant 
points.  Subjective  situation  awareness  and  workload  data  were  collected  by 
questionnaire  during  breaks  between  initial  conditions. 


PILOTS 


Ten  pilots  were  employed  in  the  evaluation.  Six  of  these  were  McAir  pilots  with 
previous  operational  fighter  experience.  Each  of  the  four  pilots  supplied  by  TAC  also 
were  previous  or  current  fighter  pilots.  The  total  group  encompassed  more  than  5,000 
hours  of  experience  in  F-15,  F-4,  F-lll,  F-100,  and  F-106  aircraft.  All  pilots 
participated  in  all  phases  of  both  the  air-to-air  and  air-to-ground  missions  at  least 
once . 
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Figure  9.  Air-to  Ground  Mission  Segments 
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RESULTS 


Per forma nee  data  and  subjective  workload  data  and  situation  awareness  data  were 
collected  during  testing  in  both  the  stall  and  the  dome.  At  this  writing  only  the 
subjective  data  from  the  stall  testing  has  been  analyzed.  A  situation  awareness 
measure  devised  tot  evaluation  and  the  Subjective  Workload  Assessment  Technique  (SWAT) 
were  useu.  The  situation  awareness  scale,  shown  in  Figure  11,  was  based  on  the 
definition  of  situation  «  ireness  given  at  a  symposium  sponsored  by  the 
57th  Fighter  Weapons  i.  *,i  3.  The  preliminary  results  shown  in  Figure  12,  indicate  the 
missions  were  perf**  '  u  with  high  levels  of  situation  awareness  and  moderate  levels  of 
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information  was  missing  or  inconsistent. 


1.  "position"  includes  heading,  speed,  attitude  and  relationship  to  the  ground. 

2.  "forces"  means  all  forces  air/ground. 

3.  "status"  refers  to  internal  conditions  of  the  aircraft  fuel,  sensor 
availability,  etc. 


Figure  11.  The  Situation  Awareness  Scale 
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FORCES  FORCES  OPTIONS  AIRCRAFT  POSITION  QUALITY 

SEGMENT 
AIR-TO-AIR 

TAKEOFF  4.3  3.7  5.0  4.7  5.5 

SCI  TO  CAP  5.2  4.7  5.2  5.7  5.7 

INTERCEPT  ONE  5.5  6.2  5.7  5.5  5.7 

INTERCEPT  TWO  5.8  6.5  5.3  6.0  5.5 

C3  TO  TARGET  5.8  5.5  5.7  5.8  5.5 

VISUAL  ID  4.5  4.7  5.3  5.7  5.8 

APPROACH  C.O  5.7  5.3  5.7  5.8 
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Figure  12.  Mean  Situation  Awareness  and  Workload  Ratings 
During  Stall  Testing 
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3.  I  was  always  aware  of  my  owr  options . 

4.  The  status  of  my  own  aircraft  could 
always  be  determined  easily. 
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Summary: 

An  example  of  the  concept  of  a  knowledge  based  sensor  fusion  system  will  be 
presented,  which  combines  a  radar  primary  sensor  with  an  IR  secondary  sensor.  The 
radar's  wide  range  of  view  is  used  for  Target  Recognition  over  a  large  area,  while 
the  IR  sensor's  high  resolution  at  a  small  angle  of  aperture  is  employed  for  target 
classification. 


1 .  Basic  co nsiderat ions 

Although  much  has  been  done  in  the  field  of  target  fighting  to  reduce  the  exposure 
time  of  one's  own  platform  (e.g.  Third  Generations-,  Fire  &  Forget  -  Missiles), 
modern  target  reconnaissance  still  depends  largely  on  the  performance  of  the  human 
observer,  which  is,  of  course,  governed  to  a  large  extent  by  the  degree  of  stress 
felt  in  the  prevailing  battlefield  situation. 

Enhancing  combat  efficiency  and  improving  the  survival  rate  of  friendly  weapon 
systems  tnerefore  requires  a  greater  automation  and,  in  consequence,  acceleration  of 
the  processes  of  target  reconnaissance  up  to  weapon  alignment. 

Since  no  sinqle  sensor  will  be  available  even  in  the  distant  future  to  provide  all 
the  required  information  by  itself,  it  will  be  necessary  to  have  an  aggregate  of 
sensors  supplementing  and  supporting  each  other  by  virtue  of  their  specific  qualitio 

However,  it  will  be  a  special  feature  of  future  sensor  systems  that  not  the 
improvement  of  individual  sensors  will  enhance  scope  and  efficiency  of  any  weapon 
system,  but  the  combination  of  several  sensors  with  powerful  methods  of 
Mu  It isensor-Processi ng . 


There  are  three  basic  principles  to  combine  sensors  in  a  target-acquisition-system 

(fig.  1  > : 

-  the  use  of  several  sensors  of  the  same  type  (monospectral)  with  the  same  quality 

and  the  same  parameters  to  enlarge  the  field  of  view  (FOV) 

-  the  use  of  different  sensors  with  identical  FoV's,  but  in  different  spectral  ranges 

to  enhance  the  efficiency  in  detecting  and  identifying  targets  even  on  adverse 

conditions  (bad  weather,  counter  measures,  camouflage)  and  to  reduce  failure 
probability  by  redundancy. 

-  the  combination  of  a  Wide-Field-Of-View  (WFOV)  and  Narrow-Field-Of  View  (NFOV) 
sensor  in  a  hierarchical  structure  to  get  the  advantages  of  the  first  called 
possibilities: 

-  Monitoring  a  large  area  by  sensors  with  less  resolution  but  with  a  great  power  in 
detecting  (e.g.  Radar) 

-  Identifying  targets  by  sensors  of  high  resolution  (e.g.  IR-Camera),  but  NFOV. 

-  Cueing  the  NFOV-Sensor  by  the  WFOV-Sensor. 

This  report  contains  first  results  of  a  sensor  fusion  with  this  cueing  idea. 

2.  The  Senspr-Fus'  ,n -Concept 

On  condition,  that  the  sensor  combination  has  to  observe  only  objects  on  a  plain 
area,  it  is  possible  to  transform  the  pixels  of  one  sensor  to  the  pixels  of  the  other 
one.  By  this  way  it  is  possible  to  emphasize  certain  macro  structures  in  the 
NFOV-Sensor  (here:  TV-Camera),  e.g.  streets,  tracks  of  fields,  edges  of  forests.  It 
is  not  possible  to  enhance  smaller  objects,  because  the  resolution  of  WFOV-Sensor 
(here:  Radarf rontend)  is  not  good  enough  to  distinguish  shapes. 

Effectively  this  condition  does  not  exist.  We  are  forced  to  detect  low  flying  objects 
(e.g.  helicopters);  the  countryside  never  will  be  a  mathematical  plain;  the  radar  is 
ambiguous  in  the  elevation,  the  reproduction  of  the  perspective  sensor  is  ambiguous, 
if  the  ground  is  unknown.  So,  this  kind  of  fusion  is  unusuable,  even  the  needed 
computer  power  would  be  tolerable. 
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Possible  alternatives  are: 

Mode  1  Generating  frames  within  the  NFOV-picture  to  mark  the  regions,  in  which  the 
WFOV-detected  targets  could  be. 

Mode  2  Marking  the  position  of  NFOV-identif ied  objects  in  the  WFOV-picture  to  get 
track  of  the  situation. 

Mode  3  Generating  a  synthetic  picture  like  fig. 3,  showing  the  situation  like  mode  2, 
combined  with  clipped  windows  like  mode  1. 

Mode  4  Reducing  the  information  of  mode  3  to  a  statement  like  this: 

Target  of  type  z  in  position  x,y,  priority  1 

In  future  systems  (e.g. armoured  helicopters  of  the  next  decade)  modes  3  and  4  are 
needed.  Mode  4  is  necessary  for  automation  of  the  target  acquisition  to  the  target 
alignment  process. 


To  reach  this  goal,  a  system  like  fig.  2  is  needed.  For  each  sensor  we  need  two 
control  loops.  One  loop  is  to  control  the  operating  mode  of  each  sensor,  e.g.  pulse 
rate,  scan  center,  scan  width  and  height,  transmitting  power  of  the  radarf rontend  or 
visual  line  and  focal  distance  of  NFOV-Sensor. 

The  second  loop  is  to  adapt  the  necessary  preprocessing  algorithms  to  the  actual 
situation.  The  resulting  informations  of  all  sensors  are  gathered  and  interpreted  in 
the  knowledge  based  system,  supported  by  object  modelling  data  bases.  The  result,  a 
compressed  information  like  mode  4,  is  sent  to  displays  or  to  the  arms  directly. 

3. .  First  results 

Fig.  3  shows  a  display  in  mode  3.  The  background  shows  the  information  of  the  used 
radarf rontend .  The  system  is  positioned  on  the  top  of  a  tower.  The  height  is  about 
25  m.  The  range  of  the  radar  scan  is  about  3500  m.  The  five  displayed  windows  show 
the  information  of  the  used  TV-Camera  (NFOV-Sensor) .The  equivalent  areas  are  marked 
by  circles. 

Fig.  4  shows  a  clipped  area  of  the  rough  radar-data  of  fig.  3.  We  can  notice,  that 
the  target  (marked  by  the  arrow)  is  alike  other  echos  of  chimneys  (upper  side  of  the 
figure),  road  signs  or  clutter. 

This  figure  proves  the  necessity  of  radar  preprocessing.  Fig.  5  shows  one  example.  On 
the  left  side  you  see  the  rough  data,  on  thr-  right  side  the  selected  targets  after 
preprocessing . 

Fig.  6.  shows  the  picture  of  the  used  TV-Camera,  equivalent  to  fig.  4.  The  marked 
window  (compare  mode  3)  shows  the  position  of  selected  target.  It  is  very  difficult 
to  detect  the  target  itself  without  the  help  of  the  sketched  frame.  It  is  obvious 
that  the  hierarchical  structure  of  the  WFOV  and  NVOV-Sensor  is  very  helpful. 

To  identify  the  target,  look  at  fig.  7.  It  shows  the  enlarged  window  of  fig. 6.  On  the 
left  half  you  can  see  about  64  different  grey  shades  and  you  can  identify  them  as  a 
small  bus  (in  German:  Kleinbus) .  To  gain  this  information  automatically,  it  is 
necessary  to  preprocess  the  NFOV-pictures ,  too.  On  the  right  side,  there  is  an 
example  of  an  equivalent  segmentation  process.  Only  3  grey  shades  remained.  To 
identify  the  remaining  pixel-areas  as  a  Kleinbus,  it  is  necessary  to  extract 
additional  features  and  to  compare  them  with  stored  features  of  object  models.  This 
work  is  in  progress  and  must  be  discussed  later. 
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PILOTES  SUPERVISORS  ET  GESTIONNAIRES  OR  SYSTEMES  AUTOMAT IQUES 
UN  NOCJVEAU  ROLE  BIEN  RISQUE  POUR  LA  PIABILITE  tXJ  COUPLE  HOMME-MACHINE 
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C .  E.  R,  M .  A. 

26  bd,  Victor 
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RESUME 

Lg  materiel  automatise,  hautement  fiable,  dispomble  a  bord  des  avions  a  fait  evoluer  le  partake  des 
taches  homme-machine.  Les  observations  faites  a  ce  jour  et  les  acquis  de  la  psychologic  r-vjni'-’ve  demontrent 
en  fait  que  ce  pilote  ne  supervise  pas  toute  l'activite  de  la  machine  mais  simplement  quelques  "noeuds"  qui 
sont  des  resultats  ou  des  etapes  de  l’activite  ou  le  pilote  est  directement  implique.  L'operateur  a  recent  re 
la  representation  de  la  tache  sur  ce  qu'il  parait  etre  "sa  tache".  Ce  que  fait  le  systeme  ne  figure  alors 
qu'en  resume  dans  cette  meme  representation. 

II  est  notamment  demontre  a  partir  d 'etudes  realisees  en  aviation  militaire  et  civile  que  la  represen¬ 
tation  que  le  pilote  s'assigne  dans  la  relation  homme-machine  est  fortement  conditionnee  par  la  capacite  et 
la  fiabilite  qu'il  affecte  au  systeme.  A  partir  d'un  certain  seuil  de  fiabilite  conferee  au  systeme,  le 
partenaire  humain  se  desengage  de  la  tache  faite  par  ce  systeme.  La  representation  de  son  travail  s'appauvrit 
quant  a  cette  tache  devenue  automatisee.  Dans  ce  cas,  la  capacite  de  l'operateur  a  depister  les  erreurs  dimi- 
nue,  qu’il  s'agisse  des  erreurs  de  la  machine  ou,  plus  souvent,  des  erreurs  de  ce  meme  operateur  au  moment 
ou  il  a  parametre  la  machine  ou  fixe  son  mode  de  fonctionnement  (et  ce  du  fait  du  moindre  controle) . 

Cet  etat  de  fait,  brosse  grace  a  des  approches  de  recherches  relevant  du  champs  de  la  psychologie 
cognitive,  souleve  des  problemes  tres  concrets  dans  la  definition  des  futurs  interfaces  homme-machine.  Plu- 
sieurs  solutions  de  reponses  sont  envisagees  en  fin  de  communicat ion . 

INTRODUCTION 

Sophistication,  condensation,  electronique  informatique,  automat Lsmes  son t  autant  de  caracter ist iques 
des  nouveaux  materiels  Aeronaut  iques ,  particuliereiuciit  ^.eux  concernant  1' interface  homme-machine  (H/M)  . 

Extraordinaire  terrain  des  percees  des  technologies  nouvelles,  de  leurs  applications. . . .  l'aeronauti- 
que  voit  se  developper  des  systemes  d'une  complexity  et  d’une  fiabilite  impressionnante  . 

Amsi,  le  taux  de  panne  rouge  d’un  Airbus  A310  est  reduit  a  presques  zero  sur  une  annee. 

Ainsi  encore,  les  centrales  a  inerties  doublees  voire  triplees  pour  s'autocontroler,  peuvent  amener 

avec  une  immense  fiabilite  1 'avion  A  plus  de  6000  kmsde  son  point  de  depart  et  a  moins  de  120  metres  d'un 

point  d'arrivee  choisi  a  1’avance. 

Un  grain  de  sable  peut  pourtant  apparaitre  dans  cet  ocean  de  certitude...  c’cst  celui  qui  cone erne 
la  fiabilite  du  partenaire  humain.  L'exemple  le  plus  trivial  reste  1 ’equipage  qui  insere  des  mauvaises 
coordonnees  du  point  a  atteindre. . . .  Le  cas  dramatique  du  Boeing  de  Korean  Air  Lines  egare  sur  le  territoire 
sovietique  en  est  une  expression  celebre  (WITKOWSKI , 1985) .  Le  paradoxe  est  ici  que  la  certitude  que  develop- 
pe  1 ’equipage  vis  a  vis  de  la  fiabilite  de  son  systeme  de  navigation  1 'entourage  a  ne  pas  verifier  involu¬ 
tion  de  la  navigation  pourtant  de  plus  en  plus  aberrante  par  rapport  au  but  fixe. 

Pour  plagier  un  terme  aeronautique ,  il  est  concevable  de  dire  que  1’ equipage  est  dans  ce  cas  "sort l 

de  la  boucle".  Il  ne  realise  plus  de  controle  de  processus,  le  processus  evoluant  pour  son  propre  compte. 

Ces  considerations  ne  sont  pas  nouvelles.  Elies  s’inscrivent  dans  le  cadre  d’une  veritable  transfor¬ 
mation  de  la  tache  du  pilote  (SANTUCCI  et  Coll. ,1984). 

Le  pilote  est  maintenant  devenu  un  veritable  gestionnaire  de  systemes  complexes.  Il  touche  moins  (ou 
pas  du  tout)  aux  commandes  de  vols  et  il  gere  plus  les  systemes  d’armement  et  de  navigation. 

Mais  qu’en  est-il  exactement  de  cette  tache  de  gestion?  Elle  semble  ne  plus  inclure  un  controle  de  pro¬ 
cessus  minutieux  pour  chaque  systeme  (qui  a  ce  role?,  ...  l'ordinateur  de  bord?).  Elle  ne  semble  pas  inclure 
non  plus,  et  cela  est  paradoxal,  certaines  facettes  du  role  de  superviseur  que  l’on  croit  etre  partie  prenante 
de  la  tache  du  pilote. 

Cet  article  a  justement  pour  but  de  comprendre  un  certain  nombre  d'erreurs  en  Aeronautique  en  analysant 
le  modele  mental  que  developpe  le  pilote  charge  en  fait  d'un  controle  de  vol  (et  umquement  de  ce  controle). 
Les  inadequat ions  de  ce  modele  face  aux  exigences  requises  apparaissent  comme  autant  d 'expl icat ions  poten- 
tielles  des  erreurs. 

Notons  encore  avant  de  commencer  l'analyse  que  les  etudes  classiques  sur  i'erreur  mettent  1 'accent  sur 
la  fiabilite  du  materiel  pour  certaines,  sur  la  fiabilite  de  I'homme  jour  d'antres. 

Une  conception  desormais  classique  (symposium  OTAN,  1984)  considere  me.ne  I'homme  comme  le  facteur  li- 
mitant  des  systemes  d’armes. 

Nous  voudrions  dans  cette  approche  nous  positionner  de  fagon  paradoxale  par  rapport  aux  deux  attitudes 
enoncees  en  imputant  le  manque  de  fiabilite  de  I'homme  a  l'exces  de  fiabilite  du  systeme.  Cette  idee  a  vie  pi 
ete  evoquee  notamment  par  WIENER  (19185).  On  peut  en  effet  faire  l’hypothese  triviale  que  le  modele  mental 
de  l 'action  developpe  par  l'operateur  est  en  grande  partie  dependant  du  systeme  sur  lequel  il  travaille  et 
de  la  connaissance  de  son  systeme  qu'il  acquiert  progressivement . 

L'idee  d'un  operateur  devenu  superviseur  n'est  pas  propre  a  1 ' Aeronaut ique,  (voir  par  exemple  BISSERET, 
1984) ,  mais  les  consequences  sont  fiarticulierement  importantes  dans  cette  branche  d'activites. 


Pour  developper  ies  elements  en  faveur  d’une  telle  these,  nous  envisagerons  ics  apports  de  la  littera- 
ture  dans  le  domaine  du  fonctionnement  et  de  1 ’acquisition  de  1' expertise  dans  le  cortrole  de  processus.  Des 
exemples  Aeronautiques  issus  de  nos  propres  travaux  illustrercnt  des  connaissances  edictees  souvent  dans 
des  domaines  autres  que  1' Aeronaut ique. 

I  -  PQWCT 1QWNEMKNT  COGNITIF  PAHS  LE  CONTROLS  DE  PROCESSUS 

La  cache  de  controle  de  processus  en  pilotage, peut  etre  definie  comme  le  controle  en  temps  reel  par 
l'homme  d’un  deplacement  dans  1'espace  gere  par  des  systemes  (propulsifs  ou  de  guidage) .  L’homme  est  capable 
de  cornger,  surveiller,  eventuel lement  arreter  1 ‘evolution  grace  a  un  certain  nombre  de  commandes  et  de 
controlen. 

Les  commandes  sont,  sur  les  avions  actuels,  gerees  automatiquement  par  le  systeme  (pour  une  large  part) 
mais  le  pilote  peut  surpasser  ces  automatismes  a  tous  moments  et  faire  manueliement  les  corrections  qu'il 
souhaite  (exemple  type  :  ie  pilote  automatiqoe) 

L'ensemble  des  con troles  (ecran  de  visualisation,  cadran  divers,  etc...)  lui  fourni  un  etat  code,  ins- 
tantanne  du  processus  -  en  quelque  sorte  une  representation  du  reel  -  Cette  representation  du  reel  est  1‘ oeu¬ 
vre  du  constructeur  et  des  manufacturers  deplanchesde  bord.  Elle  ne  prend  pas  signification  pour  le  pilote 
que  s’il  a  appris  le  codage  propose. 

Longtemps  stable,  ce  codage  a  evolue  rapidement  ces  dernieres  annees  du  fait  des  possibilites  de  l'elec- 
tronique  et  des  afficheurs.  Les  informations  de  synthese  (synthese  de  plusieurs  autres  informations)  sont 
maintenant  affichees  et  animees  en  temps  reel.  Elies  sont  censees  economiser  a  l'operateur  le  travail  qu’il 
devait  jusque  la  realiser  lui-meme  pour  developper  un  jugement.  En  ce  sens  leur  apparition  a  fait  se  deplacer 
la  frontiere  du  partage  des  taches  H/M.  Au-dela  du  sens,  de  la  signification  de  1 ' information,  la  forme 
d'affichage  a  egalement  evoluee  :  I'analogique  a  envahi  les  ecrans.  Par  exemple  e’est  un  dessin  de  piste  qui 
se  projette  sur  le  parebrise  lors  de  1 'atterrissage  et  qui  se  superpose  a  la  piste  reelle  (systeme  Persepolis 
et  derives).  La  encore,  il  s'agit  de  faire  realiser  par  le  systeme  une  partie  du  traitement  mental  que  I'ope- 
rateur  realisait  auparavant  pour  obtenir  un  resultat  similaire. 

Des  systemes  encore  plus  sophistiques  aident  l'operateur  dans  le  diagnostic  et  le  traitement  des 
pannes.  Dans  certaines  situations,  ces  systemes  amenent  l'operateur  a  sauter  des  etapes  dans  son  raisonnement . 

II  va  plus  vite,  s’evite  une  analyse  en  profondeur,  dispose  deja  de  conseils  d’actions,  mais  sa  representa¬ 
tion  mentale  de  la  situation  change  en  consequence.  RASMUSSEN  et  GOODSTEIN  (1985),  REASON  (1986)  soulignent 
le  potentiel  danger  de  cette  evolution  qui  laisse  a  l’operateur  1 ’entiere  responsabilite  de  1 'execution 
d'actes  pour  lesquels  il  a  tronque  sa  demarche  intellectuelle  d'analyse  de  la  situation. 

Ces  faits  conduisent  a  s'interroger  precisement  sur  le  contenu  de  la  representation  mentale  :  il  s’agit 
avant  tout  de  connaissances,  regroupees  fonctionnellement,  et  transferees  de  la  memoire  a  long  terme  vers  la  me- 
ntnre  de  travail  ccmpletee  par  des  elements  factuels  de  la  situation  ;  quand  il  s'agit  de  schemas,  ils  sont  parti¬ 
cularises  aux  valeurs  de  cette  situation  factuelle. 

Le  fonctionnement  de  cette  representation  mentale  est  essentiel  au  controle  de  processus.  OCUANINB  a 
developpe  la  theorie  de  1 'operativite  (1981)  pour  bien  souligner  le  caractere  evolutif,  deforme,  laconique, 
centre  sur  le  but  poursuivi,  du  contenu  de  cette  representation. 

Cet  auteur  distingue  justement  cette  representation  operative,  regulatrice  de  1 'action,  d'une  autre 
categone  de  representation  dite  cognitive  qui  est  un  instrument  de  connaissance  centre  sur  un  objet  et 
essayant  de  le  refleter  de  la  fagon  la  plus  exhaustive  possible. 

LEPLAT  (1985)  prefere  au  terme  de  representation  operative,  celui  de  representation  fonctionnelle.  Il 
leve  ainsi  une  ambiguite  possible  avec  les  stades  operatoires  de  Piaget.  L’esprit  reste  cependant  le  meme  : 
la  representation  apparait  comme  la  source  de  la  planif ication,  du  guide  et  de  la  regulation  de  1 'action. 

Une  etude  recente  menee  a  notre  laboratoire  (AMALBERTI,  VALOT,1985;  AMALBERTI  et  Al.,  1986-1987)  con- 
firme  le  role  essentiel  de  la  plasticite  de  cette  representation  en  fonction  dt  la  perception  subjective  par 
l'operateur  des  contramtes  de  la  situation  et  des  outils  mis  a  sa  disposition. 

Nous  avons  sur  une  duree  de  quatre  ans  mis  a  plat  1 'expertise  d'un  pilote  de  combat  par  des  methodes 
alliant  differentes  techniques  d'entretiens  et  d 'observations  en  vol  reels,  ce  travail  considerable  est 
poursuivi  actuellement  par  une  modelisation  informatique  des  activites  mentales  du  pilote  de  combat.  Cette 
modelisation  est  realisee  dans  la  perspective  du  dive l oppement  d'un  systeme  de  detection  et  de  recuperation 
precoce  d'erreurs  humaines  base  sur  un  analyseur  de  contexte  temps  reel. 

Il  n’est  pas  de  propos  dans  cet  article  de  decrire  tout  le  detail  des  resultats  obtenus  mais  nous  en 
retiendrons  trois  aspects  demonstrates  quant  a  la  plasticite  des  modeles  mentaux  et  au  role  de  la  connais¬ 
sance  de  l'usager  sur  son  systeme. 

l.L.  Nous  avons  compare  un  pilote  expert  et  un  jeune  pilote  operationnel  lors  de  la  preparation  d’une  mission 
de  penetration  tres  basse  altitude  en  mauvaises  conditions  meteorologiques  (TBAGV) .  Leur  representation  du 
meme  ordre  de  mission  est  de  fait  completement  differente  :  le  jeune  consacre  les  2/3  de  son  temps  de  prepa¬ 
ration  a  la  phase  de  navigation  TBAGV  ;  il  realise  une  approche  scolaire  de  l'objectif  et  neglige  completement 
la  tactique  de  etour.  Il  a  interprets  l'ordre  de  mission  en  fonction  de  ce  qu'on  exige  de  lui  habituellement 
compte  tenu  de  son  niveau.  Sa  representat ion  de  1 'action  a  mener  est  deformee,  laconique  pour  certains  aspects, 
tres  riche  pour  d'autres. 

Inversement,  le  pilote  expert  consacre  peu  de  temps  a  la  preparation  de  la  penetration  tres  basse  alti¬ 
tude  qu’il  sait  bien  maltriser  et  etudie  plus  par ticulierement  le  cadre  tactique  de  l'objectif  et  du  retour. 

La  encore,  la  plasticite  de  la  representation  est  clairement  soulignee.  L'execution  de  la  mission  reflete 
dans  les  deux  cas  les  particularity  de  cette  preparation  et,  bien  sur,  les  resultats  en  sont  sensiblement 
differents. 


1.2.  C'est  le  meme  type  de  resultat  que  l'on  observe  quand  on  demande  a  des  pilotes  d 1 exper lences  diffe- 
rentes  de  decomposer  le  plus  profcndement  possible  le  contenu  de  leur  mission.  Les  decomposit ions  sont  un 
bon  reflet  de  leur  representation  personnelle  de  la  difficulte  de  realisation  de  chaque  phase  de  vol  :  plus 
la  phase  est  complexe  au  sens  perception  de  danger  et  exigences  en  technicite,  plus  elle  est  detaillee  et 
inversement,  plus  elle  est  simple,  moins  elle  est  detaillee  (figure  1). 

Ces  deux  resultats  demontrent  que  1'operateur  code  comme  une  connaissance  particuliere  1' estimation 
de  ce  qu'il  crott  savoir  ;  il  associe  a  chaque  schema  d'action  une  meta  connaissance  decrivant  la  difficulte 
concrete  de  la  realisation  pour  lui.  Cette  connaissance  est  probablement  revisee  apres  chaque  execution.  Il 
reserve  une  place  privilegiee  dans  sa  representation  de  l'action  a  la  description  des  sequences  qu'il 
crolt  avoir  du  mal  a  executer  et  resume  inversement  les  sequences  qu'il  crolt  connaitre  bien. 

1.3.  Ce  type  de  plasticite  est  egalement  induite  par  la  connaissance  qu'il  developpe  sur  les  outils  mis  a 
sa  disposition. 

Au  niveau  de  1' execution  sur  le  systeme  pendant  le  vol,  le  contenu  des  schemas  est  largement  dependant 
des  conna issances  d'univers  possedees  apr  ailleurs  sur  la  fiabilite  du  systeme. 

Ainsi,  en  navigation  tres  basse  altitude  sans  visibility,  le  pilote  dispose  du  schema  prototypique 
suivant  : 

passe  la  verticale  du  point  tournant, 

De  vire  a  la  nouvelle  route, 
je  reenclenche  le  PA, 

des  que  1 'avion  est  revenu  ailes  a  plat, 

je  verifie  que  j'ai  bien  programme  sur  l'ordinateur  le  bon  but  suivant, 

je  verifie  que  j'ai  la  bonne  route,  la  bonne  distance,  la  bonne  vitesse  par  rapport  a  mes 
previsions  de  preparation, 

j'estime  la  duree  de  la  branche, 

je  me  detend  et  j'attend  l'arrivee  a  5  nautiques  du  but  suivant. 

Cette  representation  focalisee  sur  les  points  d 1  interactions  entre  le  pilote  et  son  systeme  contient 
peu  ou  pas  de  controlessur  les  automates  de  pilotage  et  de  navigation.  Le  pilote  salt  qu'il  dispose  d'outils 
fiables  en  r^sp^ot-ant  certaines  conditions  :  etre  sur  le  bon  mode  pour  le  pilote  automatique  et  pour  la 
centrale  a  inertie,  avoir  verifie  recemment  (il  le  fait  en  debut  de  branche)  qu'elle  est  encore  exacte.  11 
sait  que  si  la  centrale  est  exacte  a  un  point  donne,  elle  sera  necessairement  suffisamment  exacte  a  la  fin 
d'une  branche  de  quelques  nautiques  de  long. 

Inversement,  d'autres  exemples  de  sa  connaissance  demontrent  comment  il  prend  en  compte  le  manque  de 
precision  ou  de  fiabilite  des  systemes  :  il  dispose  notammment  d ' un  boitier  de  commande  de  cap  tres  imprecis 
par  rapport  a  ses  desiderata.  Il  en  deduit  de  ventables  schemas  de  contournement  avec  des  pro^ed^i  «_s  de 
pilotage  manuel  pour  s'eviter  1' usage  de  ce  systeme. 

De  meme  il  doute  de  ia  fiabilite  du  radar  dans  certains  modes  (notamment  de  la  stncte  horizontal! te 
du  plan  de  decoupe).  Contrairement  au  pilote  automatique  ou  a  la  centrale  a  inertie,  les  schemas  utilisant 
ce  systeme  sont  en  consequence  extremement  detailles  en  terme  de  surveillance  du  bon  fonct lonnement .  Le  pi¬ 
lote  pense  que  pour  ces  cas  precis,  son  controle  doit  etre  permanent  et  qu'il  ne  peut  rien  deleguer  dura- 
blement  a  ce  type  d’automate.  ce  systeme  de  connaissance  sur  la  fiabilite  des  automates,  mis  en  place  par 
l'experience,  modifie  progressivement  et  profondement  sa  representation  de  l’action  a  mener. 

Chaque  partie  assumee  par  le  systeme  disparait  done  partiellement  de  la  representation  operative  meme 
si  les  connaissances  attenant  a  ces  actions  sont  possedees  par  le  pilote  (elles  ne  sont  dans  ce  cas  plus 
activees  et  ne  font  plus  partie  integrante  de  cette  representaiton  fonct ionnel le  mais  peuvent  etre  recueil- 
lies  lors  de  la  mise  a  plat  de  1 'expertise) . 

En  cas  de  faillite  du  systeme,  le  pilote  est  contraint  a  reconstruire  une  representation  adaptee 
aux  nouvelles  exigences  du  controle  de  processus. 

En  resume,  le  contenu  de  la  representation  de  l'action  developpee  par  le  pilote  est  fonctionnel lement 
deforme  par  rapport  a  l'action  reelie.  II  est  centre  (egocentr iquement « )  vers  les  points  reels  d ' m teractio.. 
entre  systeme  et  homme.  Tout  ce  que  le  systeme  fait  seuL  disparait  presque  de  cette  representation  et  est 
remplace  par  un  "resume  mental". 

Ce  n'est  pas  la  tache  de  1* interface  H/M  qui  est  representee,  c'est  la  tache  de  1 ’ Homme  gerant  l'in- 
terface  H/M. 

Des  lors,  chaque  automatisme  du  systeme  devraxt  logiquement  concourir  a  un  appauvr issement  de  la  repre¬ 
sentation.  Cela  est  vrai  et  faux.  En  fait,  il  s'aqit  d ' un  changement  de  contenu  de  la  representation. 

Il  y  a  redistribution  du  partage  des  taches.  Le  pilote  geie  la  tac*  .  Je  vol  et  r>;s«.:ve  dans  3a  ic- 
preserttation  une  place  plus  grande  aux  connaissances  sur  l’Univers  de  la  tache.  Il  peut  notamment  evoquer 
plus  de  scenarios  possibles  et  se  preparer  mentalement  a  leur  resolution.  Cette  attitude  est  finalement 
1 'attitude  recherchee  par  les  concepteurs  de  systeme.  Elle  est  done  a  considerer  comme  sat isfaisante.  On 
developpe  des  automatismes  en  vol  pour  liberer  les  mains  et  les  yeux  du  piiote  ...  et  son  esprit.  La  fiabi- 
lite  et  les  performances  du  systeme  jettent  de  nouvelles  frontieres  dans  le  partage  des  taches  H/M. 

Nous  venons  de  voir  comment  le  contenu  de  la  representation  so  centrait  sur  la  tache  du  pilote  et  non 
sur  la  tache  du  systeme.  Ceci  suppose  1 'acquisition  prealable  d'une  connaissance  de  ce  qui  est  capacite  de 
chacun,  et  notamment  capacite  du  systeme  lui-meme.  Le  second  chapitre  envisage  sera  done  centre  sur  1 'acqui¬ 
sition  des  connaissances  qui  permet  justement  ce  partage  de  taches. 


Le  parallele  entre  acquisition  des  connaissances  et  modifications  de  fonctionnement  de  l'operateur  est 
maintenant  une  notion  bien  classique.  FITTS  et  POSNER  (1967)  puis  ANDERSON  (1985)  distinguent  en  effet  3  eta- 
pes. 

L'etape  1  est  dite  cognitive.  Elle  correspond  a  1 'acquisition  de  connaissances  declaratives  sur  1 'ac¬ 
tion  (connaissances  sur  la  composition  des  systemes  et  leur  usage  formel  dans  1 'action). 

A  ce  stade,  ces  connaissances  declaratives  viennent  se  greffer  a  des  connaissances  generales  sur  les 
procedures  d'actions,  1' execution  proprement  dite  est  necessairement  realisee  pas  a  pas  en  faisant  appel  a 
toutes  les  regies  possedees. 

Une  deuxieme  phase  dite  associ"?*’ive"succede  a  cette  premiere  etape.  Les  premieres  erreurs  dans  la 
comprehension  initiale  sont  progressivement  eliminees.  Des  renforcements  sont  crees  entre  connaissances  qui 
"servent"  -  la  connaissance  declarative  est  trarsformee  en  connaissance  procedurale. 

Il  s'agit  du  premier  stade  ou  le  sujet  peut  etre  considere  comme  competent,  une  troisieme  etape  dite  auto- 
nome,  paracheve  la  formation  et  permet  1 ’acquisition  d’automatismes .  Les  progre^  peuvent  se  poursuivre  a 
1 '  inf ini . 

Le  point  essential  de  cette  acquisition  de  1 'expertise  est  finalement  1 ‘existence  d'un  double  codage 
des  connaissances  s  d'un  cote  des  connaissances  descriptives  theoriques,  et  de  1' autre  des  connaissances 
fonctionnelles  pratiques.  Ce  sont  ces  dernieres  qui  composent  les  schemas  d'actions  et  done  la  representation 
mentale  de  la  situation  en  couts.  Le  pilote  n'a  ni  le  temps  ni  le  souhait  de  rappeler  le  detail  des  connais¬ 
sances  qu'il  possede  sur  un  systeme  donne  cheque  fois  qu'il  a  a  se  servir  de  ce  systeme .  Ainsi,  tou jours 
dans  le  cadre  de  1* etude  sur  la  mise  a  plat  de  1' expertise  d'un  pilote  de  combat,  il  apparait  que  1 'expert 
est  capable  de  decrire  tres  precisement  l'indicateur  d' incidence  dont  il  dispose  sur  son  tableau  de  bord 
mais  est  loin  de  se  servir  dans  1 'action  de  toutes  ses  possibilites . 

Ce t  indicateur  fournit  1 'angle  du  nez  de  1' avion  avec  la  trajectoire  au  demi-degre  pres  (echelle  chif- 
free)  ;  la  valeur  est  doublee  d'une  redondance  par  voyants  colores  codant  1 'angle  de  trois  degres  en  trois 
degres. 

En  navigation  basse  altitude,  la  seule  connaissance  fonctionnelle  possedee  est  que  "vert,  e'est  bien". 
L'expert  ajoute  qu'il  est  inutile  de  lire  la  valeur  precise  de  cet  angle  puisque  que  de  toutes  fagons  : 

-  il  n'a  pas  besom  directement  de  cette  information  pour  la  menee  des  actions, 

- et  il  n'est  pas  capable  de  controier  la  pertinence  de  cette  information  ;  il  ne  sai t  pas  comment  elle 

est  construite  dans  l'ordinateur  !. 

Il  explique  qu'il  n'a  jamais  dispose  d'indicateur  d'incidence  sur  les  avions  precedents.  Cette  indica¬ 
tion  n'est  pas  strictement  utile  dans  la  menee  de  1 'action  puisqu'il  a  tou jours  su  faire  sans  elle. 

Il  utilise  alors  1* information  disponihle  en  la  detournant  partiellement  de  1' intention  du  construc- 
teur  :  il  ne  cherche  pas  a  avoir  une  valeur  precise  d'incidence,  il  verifie  simplement  la  presence  du  vert 
parce  qu'il  a  constate  qu'il  est  vert  chaque  fois  que  la  situation  est  normale  et  stabilisee. 

Ce  cas  est  un  exemple  d'une  regie  plus  generale  ;  l'operateur  utilise  preferentiellement  les  informa¬ 
tions  de  synthese  qu'il  peut,  par  un  raisonnement ,  reconstruire  de  lui-"»eme  et  done  verifier.  Il  se  sait 
capable  d'estimer  1' incidence  a  3°  pres,  done  utilise  cette  finesse  d ' information  -  plage  coloree  -  ;  mver- 
sement,  il  n'utilise  pas  le  demi-degre  parce  qu'il  est  incapable  d ' interpreter  et  de  verifier  la  pertinence 
de  cette  information. 

Il  considere  qu'il  peut  d'autant  plus  faire  confiance  au  systeme  qu'il  se  sait  capable  de  le  verifier. 
Le  paradoxe  de  cette  analyse  est  que  le  pilote,  une  fois  son  opinion  faite,  investit  1 ' information  d'une 
certaine  fiabilite  qu'il  ne  remet  plus  en  cause  par  la  suite.  Il  fait  confiance.  Pour  reprendre  les  terrrtes 
d’ Anderson,  la  connaissance  fonctionnelle  est  elaboree  a  partir  des  connaissances  declaratives  avec  des 
justif ications  precises  en  termes  de  facilite  d ' exploitation  et  de  fiabilite.  Mais  par  la  suite,  cette 
connaissance  devient  autonomy  et  ses  justifications  initiales  ne  sont  plus  evoquees  systematiquement . 

Un  autre  exemple  concerne  I ‘acquisition  de  connaissances  par  les  machinis tes  de  salle  de  controle  des 
moteurs  sur  bateaux  de  guerre  (BOURGET  et  al.  1987).  Une  alarme  remontait  per iodiquement  sur  le  dispositif 
indiquant  un  niveau  bas  carter  d'huile. 

Le  machiniste  disposait  par  ailleurs  des  regies  de  connaissances  suivantes  "si  une  alarme  apparait, 
alors  appuyer  sur  le  bouton  d ' ef facement "  et 

"si  l'alarme  disparait,  alors  conclure  que  c'  est  une  fausse  alarme". 

bans  le  cas  du  probleme,  l'alarme  disparaissait  deux  fois  sur  trois  lors  de  l’appui  sur  le  bouton  ef- 
facement.  L'operateur  a  alors  developpe  une  interpretation  coherente  de  cette  situation  :  il  n’a  pas  renus 
en  cause  les  regies  qu'il  connaissait,  il  n’a  pas  analyse  la  panne,  il  a  simplement  deduit  que  ponctuellement 
le  bouton  pouvait  se  coincer  :  il  eta  it  prisonnier  d'une  representation  mentale  ex.remement  routiniere  de 
la  situation.  Pourtant,  le  niveau  d'huile  etait  reellement  bas,  le  capteur  se  decouvrait  chaque  fois  que  le 
bateau  prenait  du  gite,  declenchant  ainsi  l'alarme  qui  s'eteignait  spontanement  quand  le  bateau  revenait  a 
l'horizontale.  L’effacement  du  a  l'appui  du  bouton  etait  simplement  une  coincidence. 

Dans  ce  cas,  l'operateur  est  prisonnier  d'une  certaine  simplicity  de  la  representation  mentale  qu'il 
utilise,  largement  basee  sur  des  processus  automat iques .  Il  est  tout  a  fait  capable  de  faire  1 'analyse  a 
posteriori  mais  ne  1 'est  pas  sur  le  moment  ;  il  cherche  a  resoudre  son  probleme  dans  le  cadre  de  sa  repre¬ 
sentation  sans  faire  l'effort  de  la  reviser. 

Il  s'agit  bien  la  d'un  autre  point  fonctionnel  essentiel  de  la  representation  :  elle  guide  l'operateur 
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mais  ell©  l'enferme  egalement  dans  une  “vision  limitee  du  monde"  suffisante  et  pertinente  dans  la  tres 
grande  majorite  des  cas  (et  particulierement  economique  en  termes  de  ressources  mentales,  d'ou  son  avan- 
tage)  mais  ponctuellement  dangereuse.  H  est  extremement  difficle  pour  1'operateur  de  rompre  cette  repre¬ 
sentation  pour  en  rechercher  une  mieux  adaptee. 

Or,  et  c'est  la  un  trait  fondamental,  les  systemes  automatiques  favonsent  considerablement  1' existence 
de  representations  simplifiees. 

C'est  ce  cas  gue  I'on  observe  typiquement  avec  les  directeurs  de  vols  en  Aeronautique  civile  (AMALBERTI 
a  paraitre) . 

Les  pilotes  apprenne..t  rapidement  voire  a  leurs  depens,  que  les  indications  donnees  par  ce  directeur 
de  vol  so nt  plus  pertinentes  que  toutes  variations  personnelles  (car  elle  integrent  a  la  fois  la  pente,  la 
Vitesse,  etc...).  Cette  information  de  direction  de  vol  est  construite  en  permanence  par  le  calculateur 
de  bord.  On  constate,  en  suivant  la  progression  des  equipages  trois  phases  bien  individualisees  : 

-  une  premiere,  formelle,  ou  les  eleves  apprennent  un  certain  nombre  de  regies  de  base  sur  les  prof 1 Is 
de  vol  a  respecter  (pente  max  ...  min;  Vitesse  max  ...  min....)  ainsi  qu'une  connaissance  appronfon- 
die  sur  les  modes  P.A.  et  les  directeurs  de  vols  embarques.  Il  s'agit  en  que ’que  sorte  de  connais* 
sances  declaratives. 

-  une  seconde,  ou  ils  decouvrent  reellement  le  directeur  de  vol  en  simulateur.  ils  en  sont  souvent 
surpris  car  son  suivi  manuel  demande  de  la  concentration.  Presque  systernatiquement  les  cas  ou  le 
directeur  de  vol  est  mal  suivi  se  soldent  par  des  degradations  du  vol,  objets  de  commentaires  et 
d«»  debriefings  de  la  part  du  moniteur  et  constates  d'ailleurs  par  l'eleve  lui-meme.  C'est  le  temps 
de  1 ’execution  de  la  tache  pas  a  pas.  Les  renforcements  positifs  successifs  (suivi  de  directeur  de 
vol)  et  negatifs  (degradation  par  non  suivi)  amenent  progressivement  l'eleve  a  bien  suivre  ce 
directeur.  Une  partie  des  connaissances  de  bases  a  ete  procedural isee.  Cette  partie  est  pratique  et 
s'appuie  sur  une  axiomatique  de  fiabilite  du  directeur  de  vol.  Il  n'y  a  jamais  eu  acquisition  de 
connaissances  fines  sur  la  logique  utilisee  dans  le  directeur  de  vol  a  telle  ou  telle  phase  de  vol. 

Il  y  a  transfert  de  "fiabilite"  par  une  regie  du  type  “si  le  constructeur  a  dit  que  c'est  bon  et 
que  j'ai  verifie  sur  quelques  cas  exemples  que  c'est  bon,  alors  c'est  necessairement  et  tou jours 
bon" . 

Or,  un  certain  nombre  de  contextes  font  que  le  calculateur  peut  etre  amene  pendant  plusieurs  secondes, 
et  notamment  dans  des  phases  de  vol  tres  delicates  a  fournir  des  informations  erronees.  11  peut  en  etre 
ainsi  dans  le  cas  ou  le  pilote  ordonne  par  directeur  interpose  des  vitesses  ou  des  altitudes  trop  tot,  trop 
tard...  auquel  cas  le  directeur  de  vol  applique  l'ordre  et  cree  un  ecart  potentiel  avec  la  trajectoire  que 
voudrait  suivre  le  pilote. 

Le  pilote  ne  modifie  pas  la  regie  de  base  dont  il  dispose  sur  la  fiabilite  du  systeme  ;  il  juxtapose 
+  ,,««»  n-v;"p'  1“  »*oale  de  portee  limitee  :  "si  au  decollage  ou  a  la  remise  des  gaz,  le  directeur  de 
vol  indique  un  pitch  inferieur  a  5-6°,  alors  afficher  10°  et  attendre  un  moment  pour  resuivre  le  directeur". 

La  fiabilite  du  systeme  n'est  pas  remise  en  cause  et  ce  qu'i 1  en  reste  dans  la  representation  mentale  de 
1 'action  est  toujours  aussi  dehue  d'analyses  et  de  controles  complementaires .  Le  pilote  se  place  Lui-meme 
en  situation  d’executant. 

Ill  -  CONCLUSION  -  DISCUSSION 

Lors  d'un  travail,  l'homme  anticipe  et  se  represente  mentalement  le  travail  qu'il  va  avoir  a  faire.  Le 
contenu  de  cette  representation  va  servir  de  guide  et  de  regulateur  lors  de  1 'execution.  Ce  qui  n'est  pas 
dans  la  representation  ne  sera  pas  dans  1 'action  sauf  si  il  y  a  reelaboration  d’une  nouvelle  representat ion 
des  faits,  ce  qui  est  toujours  couteux  en  termes  de  temps  et  d’energie. 

La  representation  du  travail  que  l'homme  s'assigne  dans  la  relation  homme-machine  est  fortement  condi- 
tionnee  par  la  capacite  et  la  fiabilite  qu'il  affecte  au  systeme.  A  partir  d'un  certain  seuil  de  fiabilite 
confere  au  systeme,  le  partenaire  humain  se  desengage  de  la  tache  faite  par  le  systeme.  La  representation 
de  son  travail  s’appauvrit  quant  a  cette  tache  devenue  automatisee.  Cet  appauvr issement  peut  s ' accompagner 
d'un  enrichissement  dans  d'autres  domaines  notamment  :  la  tactique,  la  reflexion  sur  la  mission  ...  etc. 

Il  s'agit  bien  du  but  poursuivi  en  aviation  militaire. 

Cette  position  de  superviseur  face  a  des  systemes  hautement  fiables  n'est  probablement  et  ma lheureusement 
que  formelle. 

Deconnecte  du  con  t.  role  de  processus,  possedant  peu  de  connaissances  sur  le  systeme  lui-meme  qui  soient 
utilisables  ef f icacemen t  (il  faudrait  des  connaissances  procedurales  et  non  declaratives)  et  ce,  essentiel- 
lement,  parce  que  la  pratique  est  ranssime,  le  pilote  developpe  avec  beaucoup  de  difficultes  une  represen¬ 
tation  mentale  de  sa  tache  correspondent  ef f ecti vement  a  une  tache  de  supervision.  Il  delegue  beaucoup  au 
systeme  et  ne  garde  dans  sa  representation  de  1 'action  que  quelques  "noeuds"  de  passage  qui  correspondent 
etrangement  aux  seules  etapes  communes  entre  ce  qui  etait  avant  "sa  tache"  et  ce  qui  est  maintenant  "la  tache 
des  systemes".  Il  ne  supervise  plus  le  controle  de  processus  au  sens  vrai  du  terme  mais  simplement  le  passage 
a  des  noeuds,  accessibles  a  sa  comprehension,  qui  lui  temoigne  que  le  systeme  marche  bien,  et  qui  peuvent 
etre  distants  de  plusieurs  minutes. 

La  tache  de  superviseur  est  ef fecti vement  effectuee  pour  les  noeuds  mais  ne  l'est  plus  du  tout  pour  les 
sequences  intermediates  avec  tous  les  risques  que  cela  comporte. 

Une  fois  acquise,  cette  croyance  dans  la  fiabilite  agit  comme  un  filtre  dans  les  regies  de  connaissances 
qui  vont  etre  proceduralisees  pour  etre  utilisees  ef fectivement  comme  procedures  d'actions  et  contenus  des 
representations . 
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Bn  conclusion,  les  systemes  hautement  f tables  peuvent  etre  categorises  en  deux  : 

*  ceux  done  l'operateur  pergoit  la  haute  fiabilite  et  dont  le  f onctionnement  est  dutonome  :  cas  des 
centrales  a  inerties,  cas  du  pilote  automatique  ...  etc. 

Dans  ce  cas  la  representat ion  de  1 ’action  developpee  par  1 'operateur  ne  contient  plus  qu'un  resume 
superfieiei  de  la  -'viuence  automatisee  et  l'operateur  decentre  sa  representation  sur  le  debut  et  la 
fin  des  sequences  j*  unatisees,  la  ou  il  a  a  intervenir.  II  n'exerce  pas  de  controle  particulier  sur 
la  sequence  automatique  car  il  n'y  a  plus  dans  la  representation  mentale  de  1 'action  de  regies  spe¬ 
cif  tques  pour  le  controle  de  ces  actions  automatisees  (ce  qui  ne  veut  pas  dire  que  ces  regies 
n'existent  pas  ...  elles  sont  meme  parfois  possedees) . 

1  s’aqit  de  fait  d'un  partage  Vrai  des  taches  entre  homme  et  systeme  qui  existe  meme,  si  les  const- 
qnes  recommandent  d’autres  voies. 

L'operateur  "sort  completement  de  la  boucle"  au  niveau  de  ces  automat ismes .  Toute  situation  inciden¬ 
tal  le  est  alors  grave  a  de  multiples  egards  : 

.  detection  difficile  par  manque  de  controle, 

.  diagnostic  difficile  par  manque  ou  par  pauvrete  de  la  representation  de  la  situation 
inoidentelle. 

En  quelque  sorte,  plus  le  materiel  est  fiable,  moms  l’operateur  est  lui-meme  fiable  face  a  des 
anomalies  de  ce  materiel. 

-  ceux  dont  l’operateur  pergoit  la  haute  fiabilite  et  dont  le  fonct lonnement  suppose  un  operateur  en 
I^osition  d'exeoutant  d'ordres  :  directeur  de  vol,  ... 

[Ians  ce  cas,  la  represents* ion  de  1 'action  ne  contient  pa;:  non  plus  de  structure  de  controle  Ju  sy>- 
teme.  Elle  se  limite  a  1 'execution  manuelie  et  sans  ecart  des  actions  commandees. 

Le  par  Kioxe  est  alors  que  l  ’  homroe  croit  qu’il  est  d’autant  plus  fiable  qu'il  suit  le  systeme,  pare.-' 
qu'il  le  sait  encore  plus  fiable  que  lui. 

L'erreur  survient  souvent  dans  ce  cas  on  iram pulant  Jes  c-ommandes  iu  systeme  qui  sont  mt-ra  •*  » v*»s 
awe  le  processus  mais  dont  la  representation  mentale  dissocie  les  relations,  fautes  :U»  •"■.■nnaissan.-es 
i#uf ft  santes. 

WINNER  et  ruRRY  (1900)  s' iiuci  sur  les  raisons  qa*  pouoownt  f.n.alcment  les  construct  eurs  a  i  jt,- 

matiser  de  plus  en  plus  puisque  I'on  sait  les  etfets  neqatit's  que  cela  eomporte  sur  la  liability  de  l'horore. 
Ils  evoquent  plusieurs  raisons  :  technclogie  dispomble,  security,  econome,  fiabilite,  sinj  i  i.-ite  )e  la 
maintenance,  reduction  de  la  change  de  travail,  precision  des  manoeuvres  de  v»l,  flexibility  des  at  f  i  •  •beurs.  . 
.  . .  etc . 

11s  proposent  egalement  une  solution,  celle  du  "flight  management  by  exeption"  qui  consiste  en  tout. 

1  ieux  et  en  depit  de  toutes  regies  a  autonser.  le  pilote  a  fa  ire  ce  qu'il  veut  avec  son  jvj  :i  ;  les  system  e:- 
rie  siqnalant  que  les  sorties  du  domaine  de  securite.  11  s’aut  ici  de  renverser  completement  la  tendance  a;- 
t.uelle  et,  tout  en  gardant;  la  technoloqie,  de  reivlre  completement  manuelie  la  v^ndui  te  du  vd.  ;*e^t  in- 
proposition  dofendable,  mais  qui  a  bien  sur  ses  limites. 

Mo  us  y  mettrons  cote  a  cote  une  autre  idee  :  les  interfaces  h/M  ont  ete  construits  ]»>ur  peir.ettte  ,i 

I  'v^iateur  de  dirige-  les  machines.  Pendant  longtemps,  on  a  adept e  les  informations  et  les  •mniar.les  pour 
qu'elles  deviennent  utilisables  par  l’homme.  cela  s’appelait  l'pryonomie  mais  le  mot  n'existaif  pas. 

Aujourd'hui  on  veut  trouver  une  place  a  l’operateur  qui  est-  present,  face  a  des  systemes  automat  iques 
hautement  fiables.  On  lui  affecte  le  role  de  superviseui , . . .  mais  on  ajoute  qu'il  serait  regrettable  qu'il 
mtervienne  sur  le  systeme  sans  raison  justifiee.  Le  champs  d’action  resultant  est  etroit.  BRAINBRIDGE  foite 
in  BISSERET,  1984)  montre  portant  que  plus  un  systeme  de  controle  est  automatism  plus  la  contribution  de 
l'operateur  humain  y  est  cruciale.  En  effet,  ce  qui  reste  au  superviseur,  e'est  justement  ce  que  le  concep- 
teur  n’a  pas  Su  automatlser  parce  qu'il  n’a  pas  su  le  prevoir.  BISSERET  dans  le  meme  article,  s'opposant  U 
WIENER  et  CURRY,  pense  que  la  solution  n'est.  pas  de  uiminuer  I05  automat  1  smes  car  !,-ctjvite  re.tituee  ainsi 
a  l'operateur  serait  interactive,  "reglee",  et  de  toutes  fagons  n’aiderait  pas  a  la  resoluti--  d' incidents. 

II  conseille  de  donner  aux  operateurs  des  taches  "qual  1  f lantes”  durant  les  per  lodes  de  temps  libte  pour  les 
preparer  a  faire  face,  aux  situations  anormales.  L<<  encore  ce  point  de  vue  est  defendable  mais  connait  ses 
lirni tes . 

Ainsi ,  au  bilan,  maintenant  que  l'erqonomie  classique  s'est  developpee,  force  est  de  constater  que  ie 
champs  des  demandes  impose  une  nouvelle  evolution  radicale  de  Cette  discipline  pour  refxmdre  a  des  questions 
d'une  extreme  complexity  portant  sur  le  fonct lonnement  mental  de  l'operateur. 

Ces  reponses  ne  peuvent  plus  e^re  du  seal  domaine  de  I'eryonome  car  elles  r.ouehent  a  la  philosophic 
de  la  place  de  1 ' homme  dans  le  travail. 

Pour tant  ,  il  y  a  plus  que  jamais  a  faire  et  a  dire  .  a  moms  que  les  inqemeurs  ne  souhaitent 

concevoir  th  ■  robots  ... 
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ABSTRACT  : 


Through  developping  navigation  and  attack  systems  on  combat  aircraft  and  by  analysing  the  new  operational 
concepts,  an  always  increasing  workload  is  required  from  the  pilot. 

AMD-BA  have  been  concerned  with  this  problem  for  many  years  in  designing  each  different  combat  aircraft. 

An  important  part  of  the  workload  lies  in  getting  the  management  informations  by  the  pilot.  In  case  of 
very  low  level  flying,  getting  these  informations  become  especially  tight  :  the  pilot  cannot  divert  his  attention 
from  outside  the  cockpit  to  watch  over  the  vehicule  and  its  system. 

For  this  reason,  modern  fighter's  cockpit  -  such  as  on  the  different  versions  of  the  MIRAGE  2000  and  now 
on  the  RAFALE  -  are  already  oriented  on  using  head-up  terminals  for  displaying  built-up  informations.  Enhancements 
have  been  made  on  displays  in  order  to  increase  the  capacity  of  collimated  data. 

In  addition,  synthetic  voice  warnings  are  already  used  and  days  after  days,  the  place  of  speech  processing 
is  increasing. 

For  the  future,  AMD-BA  are  studying  the  benefit  of  artificial  intelligence  technics  for  improvement  of 
displays  and  spoken  messages  in  working  at  two  levels  : 

-  in  the  pertinence  of  information  depending  on  the  phases  of  the  mission  and  especially  on  the  pilot  workload 

which  is  inferred  by  the  expert  system, 

-  in  the  suitable  synthetic  information  to  help  the  pilot  in  decision  making. 

AMD-BA  are  working  on  an  Expert  System  which  purpose  will  be  precisely  to  operate  at  these  two  levels 
depending  both  on  its  importance  with  respect  to  the  mission  and  on  the  workload  inferred  by  the  Expert  System 
in  the  different  steps  of  the  mission. 


I.  INTRODUCTION 


Le  but  de  rette  presentation  est  de  m.ontcec  tout  d’abord  quels  sent  les  soins  apportos  depuis  long  temps 
a  I'organisation  des  postes  d'equipage  des  chasseurs  au*  AMD-BA,  quellos  sont  les  tendances  qui  sc  degagent  et 
surtout,  de  quelle  fa^on  les  techniques  d'intelligence  artifi*  ielle  peuvent  intervenir  pour  fa;re  progresser  la  conception 
de  nos  cabines. 


2.  ORGANISATION  DES  POSTES  D'EQUIPAGE 

Nous  considererons  quatre  themes  principaux,  determinants  dans  la  conception  de  la  rabine  d'un  chasseur  : 

-  ('installation  du  pilote, 

-  le  pilotage  t£te  haute  associe  au  fonctionnement  des  comrrandes  de  vok 

-  1'aide  au  pilote  pour  [a  ronduite  de  la  machine, 

-  les  nouvelles  technologies  des  equipements  de  dialogue. 


a.  L'lNSTALLATION  D( '  PILOTE 

Dans  I'etude  de  la  cabine,  romme  dans  celle  de  twit  poste  de  travail,  un  grand  win  doit  £tre  apporte 
a  I'environnement  du  pilote.  La  tendance,  pour  les  chasseurs  modernes,  est  de  faire  appel  a  des  sieges  ejcctahlcs, 
"inclines"  par  opposition  aux  sieges  ejectables  installes  jusquVi  tant  sur  les  av ions  des  AMD-BA  (MIR  AGE  III. 
MIRAGE  IV,  MIRAGE  5,  MIRAGE  FI,  MIRAGE  2000,  SUPER-MIRAGE  4000,  ALPHA  JED  que  sur  les  avions 
etrangers,  en  particulier  les  F5,  FI 4,  FI  5,  F  18  ou  TORNADO.  L'installation  d*un  siege  conferant  un  angle  de 
dos  super ieur  a  30°  d'inclinaison  par  rapport  a  la  reference  verticale  du  fuselage  sur  le  R  AFALE  A  artuellement 
en  essais  en  vol,  nous  a  perm  is  de  conforter  les  resultats  que  nous  avions  obtenus  an  rours  d'etudes  preliminaires 
rnenees  aver  le  sontien  des  Services  Offiriels  francais,  et  en  liaison  avec  le  LAMAS  et  le  CERMA.  Cette  installation 
permet  d’executer  des  manoeuvres  soutenues  a  fort  facteur  de  charge  dont  est  capable  la  machine  en  dimimiant 
notablemont  la  charge  imposee  au  pilote,  ce  qui  lui  permet  tine  meilleure  efficacjte.  Ce  gain  se  retrouve  aussi 
dans  les  accelerations  transitoires. 


Ces  bons  resultats  sont  les  fruit*  d\tn  travail  important  mene  aux  AMD-BA  ou  IHjtilisation  d*un  siege 
incline  n'a  pas  ete  considered  isolement  mais  a  fait  I'objet  dVine  etude  complete  et  approfondie  de  tous  les 
elements  relatifs  a  1'installation  du  pilote  : 

.  accoudoirs 

.  manche  et  manette  et 

.  commandes  temps  reel  associees 

.  termirvux  de  visualisation 

.  visibilite  exterieure 


b.  PILOTAGE  TETE  HAUTE  ET  COMMANDES  DE  VOL 

Les  AMD-BA  accordent  une  tres  grande  importance  aux  etroites  relations  que  les  commandes  de  vol 
doivent  avoir  avec  tous  les  elements  de  1'avion  et  le  pilote.  Les  technologies  nouvelles  des  commandes  de  vol, 
en  particular  Utilisation  de  calculateurs  numeriques  et  de  liaisons  electriques  et  bient6t  optiques,  permettent 
des  sophistications  qui  decuplent  leur  puissance  et  qui  rendent  cette  etroitesse  de  liens  encore  plus  fondamentale. 

C'est  en  particulier  le  cas  avec  les  informations  de  pilotage  a  presenter  au  pilote.  Depuis  longtemps, 
les  AMD-BA  ont  demon  tre  l'inter£t  du  pilotage  tete  haute,  dans  toutes  les  configurations  de  vol  et,  en  particulier, 
en  cas  de  vol  a  basse  altitude. 

II  est  sans  doute  inutile  de  s'appesantir  ici  sur  le  fait  que  le  pilotage  t€te  haute  constitue  une  nouvelle 
methode  de  pilotage  dont  I’interet  est  de  presenter  directement  d*une  part  la  trajectoire  de  1'avion,  avec  le 
vecteur -vitesse  (par  reference  a  ['horizon),  et,  d'autre  part,  revolution  de  la  vitesse  sur  trajectoire,  avec  le 
repere  d’energie  potentielle.  Un  exemple  de  figuration  t£te  haute  complete  est  donnee  (figure  I)  ou  se  trouve 
notamment,  en  plus  des  symboles  cites  ci-dessus,  un  reticule  de  guidage  ILS,  utijisable  comme  un  directeur 
d'ordre  pour  le  contrdle  de  la  trajectoire. 

La  cooperation  entre  cette  presentation  et  les  commandes  de  vol  est  integrale  et  trouve  sa  puissance 
dans  le  fait  que  le  pilote  peut  agir  de  fagon  decouplee,  a  court  terme,  sur  le  vecteur-vitesse  par  action  sur 
le  manche  (devenu  manche  lateral),  et  sur  I'energie  par  action  sur  la  manette.  Cette  facon  de  contrfiler  1'avion 
permet  de  rneilleurs  temps  de  reponse  que  le  pilotage  d*un  parametre  intermediaire  (assiettes  e.g.)  et  son  principe 
est  tenement  seduisant  que,  les  AMD-BA  ont  propose  puis  experiment^  en  vol  avec  le  RAFALE  A,  une  extension 
de  cette  methode  en  donnant  a  la  manette  non  plus  le  rdle  de  commande  des  moteurs  mais  la  fonction  globale 
de  commande  du  bilan  traTnee-poussee.  II  faut  d'ailleurs  remarquer  que,  contrairement  aux  usages,  cette  manette 
est  unique  alors  que  1'avion  est  bimoteur  ! 
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FIGURE  1  :  Presentation  d'informations  de  pilotage  t£te  haute 
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Comme  les  commandes  de  vol  integrent  les  limitations  de  domaine,  on  aboutit  a  un  pilotage  sans  soucis, 
tout  en  augmentant  la  precision,  i'efficacite  et  le  niveau  de  sdrete  du  pilotage.  La  superposition  des  reticules 
sur  le  monde  exterieur  supprime  ie  besoin  d^accommodation  entre  exterieur  et  planche  de  bord  et  ameliore 
la  perception  des  differents  dangers  :  reliefs  du  terrain,  superstructures  telles  que  antennes,  pyl6nes  ou  lignes 
a  haute  tension,  autres  aeronefs... 

Enfin,  le  pilotage  t£te  haute  permet  une  bien  meilleure  transition  entre  les  differents  modes  de  pilotage 
automatique  ou  assiste  et  le  pilotage  "manuel",  le  pilote  restant  beaucoup  mieux  "dans  la  boucte",  ce  qui  est 
fondamental  pour  sa  rapidite  de  reaction  en  situation  anormale. 

Dans  I'etude  des  avions  futurs,  les  principals  tendances  recherchees  par  les  AMD-BA  sont  : 

.  J'utilisation  de  collimateurs  tite  haute  holographies  qui  apportent  a  la  fois  un  agrandissement  du  champ 
(tant  instantane  que  total)  et  de  meilleures  caracteristiques  photometriques  permettant  d'obtenir  a  la  fois 
de  tres  bons  contrastes  de  symbologie,  m£me  soleil  de  face,  et  une  tres  bonne  perception  du  paysage,  en 
particulier  en  cas  de  luminosite  faible.  C'est  d’ailleurs  avec  beaucoup  de  satisfaction  qu*un  collimateur  de 
ce  type,  realise  par  THOMSON-CSF,  est  utilise,  depuis  le  premier  vol,  sur  le  RAFALE  A  ; 

.  ^augmentation  de  la  fiabilite  de  la  presentation  des  informations  en  tete  haute,  pour  rendre  ce  mode  de  pilotage 
encore  plus  sflr  et  chercher  a  eviter  les  comparaisons  entre  informations  t£te  haute  et  t£te  basse,  encore 
de  mise  dans  de  nombreux  chasseurs  ; 

.  la  mise  en  oeuvre,  par  des  reticules  simples,  fonctionnant  toujours  en  trajectoire/energie,  de  guidages  de 
tres  haut  niveau, 

.  integrant  les  nombreuses  donnees  qu'est  susceptible  de  connaitre  la  machine, 

.  optimisant  differents  criteres,  en  fonction  du  type  de  mission  et  de  la  phase  en  cours  :  depense  de 
petrole,  respect  d'un  horaire,  evitement  d'obstacles  ou  de  menaces-. 

Hans  ce  domaine,  on  verra  plus  loin  que  I'intelligence  artificielle  peut  avoir  des  retombees  interessantes. 


c.  ASSISTANCE  AU  PILOTE 

En  tant  que  concepteurs  du  systeme  complexe  et  tres  integre  que  constitue  un  chasseur  moderne,  les 
AMD-BA  ont  la  volonte  de  fournir  au  pilote  une  machine  dans  Iaquelle  celui-ci  se  sente  en  confiance. 

La  regulation  de  differents  equipements  complexes  (moteurs,  e.g.),  le  fonctionnernent  des  circuits  et 
des  servitudes,  1 'execution  automatique  de  certaines  tSches  sont  congus  avant  tout  pour  liberer  le  pilote.  En 
fait,  il  est  classique  de  constater  que  la  juxtaposition  de  ces  "automatismes"  aille  a  l'encontre  du  but  initial. 

Certains  ne  manquent  pas  de  parler  alors  d'automatismes  mal  conpis,  en  particulier  lorsqu'ils  necessitent  une 
surveillance  de  la  part  du  pilote,  d’autant  plus  difficile  a  mener  que  les  moyens  de  controle  sont  alors,  dans 
bien  des  cas,  reduits  et  la  conception  des  alertes  ou  alarmes,  peu  adaptee. 

Dans  la  demarche  menee  aux  AMD-BA,  la  mise  en  place  de  toutes  ces  assistances  entratne  une  refonte 
complete  de  la  conduite  de  la  machine  dans  le  but  (ideal)  de  realiser  une  cabine  libre  de  toute  surveillance. 

L’integratior  *es  systemes  est  a  la  base  de  cette  refonte  qui  permet  aussi  de  simplifier  les  procedures,  de  reduire 
les  signalisations  et  les  postes  de  commande  specifiques.  Un  exemple,  ponctuel  mais  revelateur  :  Sur  le  RAFALE, 
le  rel5chement  du  frein  de  pare  fait  passer  les  centrales  a  inertie  dans  le  mode  Navigation. 

Un  domaine  capital  a  ce  titre  est  la  philosophic  de  determination  et  de  presentation  des  alarmes.  L 'integration 
des  systemes  permet  de  gros  progres  dans  ce  domaine,  d'autant  pljs  appele  a  evoluer,  que  les  traitements  informatiques 
se  repandent  a  tous  les  elements  de  I'avion  et  que  le  traitement  de  I’information  devient  possible  a  differents 
stades.  La  reduction  significative  des  moyens  conventionnels  d'alarmes  (voyants  lumineux)  operee  sur  le  RAFALE  A 
est  un  indice  refletant  cette  evolution.  L'annonce  des  alarmes  fait  appel  a  une  voix  synthetique,  capable  d'annoncer 
plus  de  trente  sequences  sonores  et  vocales  differentes,  bien  discernab[es  par  le  pilote.  En  parallele  a  une  signalisation 
visuelle  dans  les  terminaux  de  visualisation,  elle  constitue  un  moyen  tres  efficace  de  presentation  au  pilote 
de  toute  situation  anormale,  a  condition  qu'elle  soit  detectee  par  la  machine- 

Les  progres  a  faire  sont  bien  sOr  dans  la  determination  de  ces  etats  anormaux  qui  doit  £tre  a  la  fois 
la  plus  pertinente  possible,  tres  sOre  vt  tres  fiable.  Voila  bien  sOr  un  domaine  clef  ou  1\j t i Iisation  des  systemes 
experts  peut  se  reveler  prometteuse  afin  d'aboutir  a  une  signalisation  : 


.  au  moment  opportun, 

.  au  bon  endrojt, 

.  ronseillant  la  bonne  action. 


d.  NOUVELLES  TECHNOLOGIES  DES  EQUIPEMENTS  DE  DIALOGUE 

Les  AMD-BA  sont  tres  attentifs  aux  possibility  offertes  par  les  nouvelles  technologies  dans  tous  les 
domaines participant  a  la  conception  des  avions.  L'inter^t  technique  du  RAFALE  A  a  ete  d'ailleurs  de  demontrer 
la  validitede  plusieurs  d'entre  elles  quo  ce  soit  pour  les  structures  (composites,  aluminium-lithium. -)pour  les 
commandes  de  vol,  ou  pour  la  cabine. 

Le  cas  du  collimateur  t£te  haute  en  est  bien  sOr  un  tres  bon  exemple.  Mais  cette  cabine  a  perm  is  aussi 
de  juger  d'autres  realisations. 
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Un  terminal  de  visualisation  d\jn  type  tout  a  fait  inhabituel  est  aussi  utilise  depuis  Je  premier  vol  du 
RAFALE  A.  li  s'agit  d*un  Collimateur  T£te  Moyenne  (CTM),  situe  en-dessous  du  collimateur  t£te  haute,  en 
continuity  de  champ  avec  lui.  11  procure  une  image  coliimatee  dans  un  rhamp  bien  plus  important  que  le  champ 
qu 'aura it  un  terminal  classique  de  surface  equivalente  situe  en  cet  endroit.  Cette  image  peut  £tre  purement 
synthetique  pour  la  presentation  classique  d'informations,  mais  on  peut  aussi  utiliser  ce  terminal  pour  presenter 
la  video  issue  d\jn  capteur,  et  m£me,  de  facon  plus  originale,  presenter  l'image  generee  par  un  capteur  electro- 
optique  angulairement  conforme  a  ce  que  le  pilote  verrait  si  la  planche  de  bord  etait  transparente. 

D'autres  technologies  prometteuses  sont  aussi  en  cours  devaluation  :  cristaux  liquides,  synthese  vocale, 
commande  vocale... 

Au-dela  de  ces  experimentations,  les  AMD-BA  recherchent  par  la  mise  en  oeuvre  de  ces  techniques, 
1'obtention  d\jn  dialogue  plus  etroit  et  done  plus  efficace  entre  le  pilote  et  la  machine,  et  ces  etudes  de  niveau 
technologique  sont  accompagnees  dVine  reflexion  sur  Jeur  utilisation  et  sur  les  principes  de  representation  de 
1 ’information  les  plus  adaptees.  Un  axe  de  recherche  tres  riche  est  la  representation  d'informations  connues 
dans  des  bases  de  donnees,  relatives  au  terrain  en  particular,  cette  representation  pouvant  s'imaginer  en  deux 
dimensions,  trois  dimensions  et  m£me  en  relief. 

C'est  dans  ce  contexte  que  les  techniques  de  1 'Intelligence  Artificielle  ont  bien  sOr  parues  dignes  dfinter£t 
et  cfest  ce  que  nous  en  attentions  qui  est  developpe  dans  la  suite  de  cet  expose. 


3.  APPORT  DES  TECHNIQUES  DE  ^INTELLIGENCE  ARTIFICIELLE 

Dans  le  futur,  le  calcul  symbolique,  utilisant  les  techniques  de  ^Intelligence  Artificielle  peut  apporter 
des  solutions  efficaces  et  interessantes  pour  les  interfaces  homme-machine  des  prochaines  generations  d'avion. 

En  particular,  des  "systemes  a  bases  de  connaissances"  embarques  permettront  de  rendre  ces  interfaces 
tres  adaptees  au  pilote,  a  sa  charge  de  travail  et  a  sa  mission. 

a.  Approche  necessaire 

Pour  utiliser  avec  profit  des  "systemes  a  bases  de  connaissances"  a  bord,  il  faut  avoir  resolu  un  certain 
nombre  de  problemes  de  natures  diverses  : 

•  Assembler  et  formaliser  l'expertise  correspondante.  Celle-ci  porte  sur  : 

+  des  aspects  techniques  comme  : 

le  savoir-faire  tactique  (evasives,  procedures  d*urgence,  mise  en  oeuvre  des  armes)  ; 

le  savoir-faire  systeme  G'avion  et  ses  ressources,  1'energie,  I'armement,  I'avionique,...); 

le  savoir-faire  operationneJ  reiatif  a  1'environnement  (relief  du  terrain,  defenses  adverses,...); 

fe  savoir-faire  strategique  reiatif  a  la  mission  ( evaluation  des  nsques  et  efficacite) ; 

+  et  sur  des  aspects  plus  "psycho log iques''  dependant  d'avantage  de  la  nature  humaine  et  de  son  comportement 
dans  un  milieu  stressant  (evaluation  des  capacites  de  raisonnement  du  pilote  en  fonction  de  1'environnement 
et  des  situations). 


.  Definir  des  traitements  symboliques  embarquables  capables  de  performances  temps  reel. 

Dans  un  tel  environnement  les  temps  de  reaction  necessaires  a  1'echelle  du  pilote  sont  de  I'ordre  dVjne 
fraction  de  seconde  a  que  Iques  secondes. 

.  Avoir  la  possibility  dVitiliser  toutes  fes  informations  disponibles  a  bord  :  tant  au  plus  bas  niveau  comme 
les  resultats  bruts  des  mesures  des  capteurs  qu*a  un  niveau  plus  elabore  a  la  sortie  d'algorithmes  specialises 
dans  le  traitement  du  signal.  Cette  deuxieme  categorie  d'information  sera  d'ailleurs  preponderate  dans 
la  'base  de  fa  its"  des  "systemes  a  bases  de  connaissances". 

b.  Methode  envisagee 

Le  but  est  de  fournir  une  aide  "intelligente"  au  pilote  au  moyen  dbne  interface  experte  ou  module  de 
communication  expert. 

Cette  interface  doit  done  reaiiser  les  fonctions  suivantes  ; 

.  Filtrer  de  fagon  pertinente  les  informations  disponibles  a  bord  ,* 

•  Fournir  une  aide  a  la  decision  : 

+  en  presentant  les  suggestions  d'action  et  les  verifies  dbypotheses, 

+  en  effectuant  des  predictions  sur  devolution  de  la  situation  et  sur  la  charge  de  travail  du  pilote, 

♦  en  rendant  compte  de  la  surveillance  de  I 'avion  et  de  ses  systemes  :  e'est-a-dire  temoigner  de  la  bonne 

prise  en  charge  des  t&ches  qui  relevent  d'automatismes  ou  dont  le  temps  de  reponse  demande  est  tres 
court  alors  qu*elles  exigent  I'examen  dim  grand  nombre  de  parametres. 
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L'interface  experte  doit  done  se  situer  dans  la  boucle  Pilote-Systeme. 

La  realisation  de  cette  interface  passe  par  : 

.  L ’etude  de  la  demarche  du  pilote  (actions  et  raisonnements)  dans  Ja  mission  de  penetration  basse  altitude, 

La  realisation  d\in  modele  general  qualitatif  de  celle-ci  qui  peut  se  symboliser  de  la  faqon  suivante  : 

0  Suivi  de  la  bonne  execution  de  la  mission  (mode  normal)  puis  en  cas  d'ecart  : 

2)  Detection  de  l'evenement  "anormal"  (evenement  perturbateur  dans  le  deroulement  prepare  de  la  mission). 

3)  Evaluation  de  la  situation  en  fonction  de  cet  evenement  et  des  autres  parametres  caracterisant  cette 
situation. 

4)  Prise  de  decision  du  pilote  en  fonction  de  cette  situation  qui  se  traduit  par  une  ou  plusieurs  actions  successives 

a  entreprendre.  ! 

5)  Execution  des  actions  desirees.  J 

Pour  realiser  ce  type  de  decision-action,  certains  travaux  (I)  ont  permis  d'identifier  trois  types  de  comportements  ^ 

humains  qui  sont  coherents  avec  le  modele  ci-dessus.  J 

.  Le  comportement  reflexe  ou,  a  une  situation  reconnue  donnee,  correspond  une  action  immediate  pour  iaquelle  I 

il  n*y  a  pas  d’optimisation. 

.  Le  comportement  tactique  ou,  a  une  situation  reconnue  donnee,  un  raisonnement  base  sur  des  regies  issues 
de  1'experience,  permet  de  decider  de  Taction  a  faire  (raisonnement  a  court  terme). 

.  Enfin  le  comportement  strategique  base  sur  la  reconnaissance  d*une  situation  nouvelle,  mais  ou  le  raisonnement 
base  sur  des  experiences  variees  permet  de  determiner  le  comportement  qui  correspondra  nau  mieux"  a 
la  situation  decouverte  et  qui  pourra  eventuellement  Stre  remis  en  cause  ulterieurement  (raisonnement 
a  long  terme). 

Ces  deux  derniers  comportements  resultent  egalement  des  capacites  de  prediction  du  pilote  sur  revolution 
de  la  situation  en  fonction  des  donnees  presentes. 

De  plus,  des  travaux  realises  en  France  au  CERMA  ont  eu  pour  but  de  "modeliser"  le  comportement 
specifique  des  pilotes  dans  ce  type  de  missions  et  ont  permis  de  realiser  des  "schemas  types"  definissant  la 
structure  de  leur  raisonnement,  leur  fa?on  de  gerer  le  temps  et  de  gerer  leurs  propres  limitations. 

Ces  travaux  pourront  £tre  le  point  de  depart  de  ('elaboration  de  la  base  de  connaissances  specifique 
du  module  de  cocrmwiication  expert.  Cette  base  servira  au  module  pour  evaluer  la  charge  de  travail  du  pilote 
dans  les  differentes  phases  de  la  mission. 


4.  EXAMEN  DES  PROBLEMES  SPEC1FIQUES  DE  LA  COMMUNICATION  PILOTE-INTERFACE  EXPERTE 
a.  Communication  pilote-module  (figure  2) 

Comme  dans  le  cas  d\jn  operateur  durant  un  processus  complexe  (2),  la  communication  avec  le  pilote 
doit  s'etablir  en  tenant  compte  des  contraintes  suivantes  : 

.  Donner  au  pilote  les  moyens  de  reconnattre  I'etat  de  fonctionnement  de  ses  systemes  embarques  et  les 
caracteristiques  du  contexte  exterieur  (situation  tactique,  menace,  meteo,  etc...), 

.  Donner  au  pilote  les  moyens  d*evaluer  la  situation  resultante, 

.  De  prendre  en  compte  les  exigences  particulieres  des  pilotes  dans  ce  type  de  mission 
Cela  impose  d'avoir,  dans  ce  "module  de  communication  expert"  : 

.  Une  certaine  representation  de  Tavion  et  de  ses  systemes. 

.  Des  moyens  de  visualisations  tres  souples  et  riches,  adaptes  au  probleme  (mission). 

.  Des  moyens  de  communications  pilote -machine  complementaires  comme  la  commande,  la  synthese  et 

le  dialogue  vocal  pour  ^introduction  d'obser  vat  ions  du  pilote. 

.  Une  base  de  connaissances  specifique  adaptee  au  probleme  de  la  communication  pilote  machine. 

.  Un  acces  a  la  base  de  faits  commune  aux  autres  systemes  experts  du  copiiote  electronique,  ce  qui  pose, 

bien  sOr,  le  probleme  de  l'utiiisation  d*une  architecture  "multi-experts". 
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b.  Fonctionnalites  du  module  de  communication  expert 

Ce  module  doit  permettre  !es  fonctionnalites  suivantes  : 

.  Utiliser  les  informations  (synthetisees)  sur  le  contexte  operationnel  et  sur  l'etat  des  systemes  embarques 
disponibles  dans  la  base  de  faits  du  copilote  electronique. 

.  Evaluer  en  fonction  des  phases  de  la  mission  (done  de  la  charge  de  travail  connue,  evaluee  et  prevue,  du 
pilote)  et  de  1'importance  des  evenements,  la  meilleure  presentation  des  informations  au  pilote  (sous  forme 
de  visualisation  ou  de  message  vocal). 

.  Avoir  la  possibility  d'etre  interroge  par  le  pilote  (sous  forme  de  dialogue  vocal  par  exemple)  sjr  un  raisonnement 
ou  sur  des  predictions  en  fonction  de  certaines  hypotheses  (What  if  ? ...). 

.  Avoir  une  base  de  connaissances  independante  des  autres  systemes  experts  embarques  mais  4tre  capable 
de  partager  les  informations  de  tous  niveaux. 


FIGURE  2  s  Integration  du  module  de  communication  expert 


5.  ACTrVITES  D'AMD-BA  DANS  LE  DOMAINE  DES  INTERFACES  POUR  L’ASSISTANCE  AU  PILOTE 

a.  Dans  le  domaine  de  la  presentation  des  informations  de  pilotage 

Nous  avons  vu  les  travaux  realises  par  notre  societe  ;  la  symbologie  a  deja  fait  l'objet  de  longues  etudes 
et  a  about!  aujourdTtui  a  une  qualite  reconnue  des  pilotes. 

Par  rapport  aux  methodes  de  calcul  classiques,  le  calcul  symbolique  pourra  permettre  la  prise  en  compte 
d*un  plus  grand  nombre  de  donnees  et  plus  de  souplesse  de  traitement  pour  ('animation  de  cette  symbologie. 

Nous  avons  en  particular  prevu  d'etudier  un  "systeme  a  base  de  connaissances"  specialise  dans  la  gestion 
et  la  presentation  de  l'energie  de  1 'avion  pour  le  pilotage. 

b.  Dans  le  domaine  des  mecanismes  de  raisonnement 

Nous  avons  entrepris  avec  le  soutien  des  Services  OfficieJs  Fran^ais  : 

.  une  etude  avec  le  Laboratoire  d'Informatique  Fondamentale  et  d'fritelligence  Artificielle  (LIFIA)  sur 
le  raisonnement  temporel  et  incertain  ; 

.  une  etude  avec  1'Electronique  Serge  Dassault  sur  le  theme  de  I 'aide  a  la  comprehension  des  pannes  et 
la  gestion  des  procedures  dVjrgence  a  bord  des  avions  de  combat. 


Dans  cette  etude  nous  abordons  deux  points  essentieJs  : 

+  L'aspect  systeme  expert  temps  reel  embarquable  ou i  seront  etudies  la  compatibility  de  Papproche 
Intelligence  Artificielle  avec  les  contraintes  imposees  par  le  temps  reel,  les  capacites  memoires 
et  les  traitements  a  mettre  en  oeuvre  pour  respecter  les  temps  de  reponse  imposes  par  Pembarquabilite 
d\in  systeme  d'avionique. 

+  L'aspect  generation  d'informations  pertinentes  correspondant  a  une  analyse  de  la  situation  de  l'avion 
et  a  un  choix,  en  fonction  des  resultats  de  cette  evaluation,  des  informations  a  presenter  au  pilote 
en  fonction  des  phases  de  la  mission.  Par  exemple,  la  detection  d*une  anomalie  dans  le  freinage 
ne  doit  pas  @tre  traitee  et  presentee  au  pilote  de  la  m€me  faqon  lorsque  l'avion  est  a  Mach  1,6  30.000  ft 
ou  lorsqu'il  est  en  approche  avant  atterrissage. 


c.  Dans  le  domaine  de  l^aide  a  la  decision  embarquee 

Nous  avons  entrepris,  egalement  avec  le  soutien  des  Services  Officiels  Fran^ais,  une  etude  de  faisabilite 
d'aide  a  la  decision  par  un  copilote  electronique  dans  une  mission  d'avion  de  combat.  Dans  ce  cadre  precis, 
et  aussi  de  maniere  plus  generale,  nous  etudions  Padequation  de  Pergonomie  de  presentation  a  la  charge  de 
travail  du  pilote  dans  les  differentes  phases  de  sa  mission.  Nous  cherchons  en  particulier  a  etablir  les  possibilites 
d*un  dialogue  entre  le  pilote  et  sa  machine  par  l'etude  de  : 

.  La  complementarity  des  messages  visuels  et  sonores 

.  L'apport  de  la  presentation  stereoscopique  des  aides  au  pilotage  et  de  la  symbologie 

.  La  possibility  pour  le  pilote  d'introduire  dans  son  systeme  (au  moyen  de  la  commande  vocale)  des  informations 
relatives  a  des  observations  faites  au  cours  du  vol. 


11  s'agit  dans  ce  dernier  cas,  d'etendre  les  capacites  de  la  commande  vocale  actuelle  a  la  comprehension 
d\in  vocabulaire  assez  defini  et  structure  adapte  aux  observations  potentielles  du  pilote. 

On  imagine  facilement  Pinter€t  d\jne  telle  possibility  pour  enrichir  la  base  de  faits  du  "systeme  embarque" 
et  de  mettre  a  jour  Pelaboration  de  la  situation. 


d.  Dans  le  domaine  des  techniques  de  Intelligence  Artificielle 

AMD-BA  fait  un  effort  important  en  Recherches  et  Developpement  (en  particulier  :  langage  naturel, 
diagnostic  de  panne,  representation  structurelle  et  fonctionnelle  de  systemes,  aide  aux  specifications,  CAO, 
architecture  "multi-experts"  ...)  qui  auront  des  retombees  dans  Paide  au  pilote  et  dans  sa  communication  avec 
la  machine. 


CONCLUSION 


II  ressort  de  cette  analyse  que  les  cockpits  des  avions  d'armes  ne  cessent  d'evoluer  au  fil  des  possibilites 
offertes  par  les  nouvelles  technologies.  Ces  technologies  font  evoJuer  les  principes  de  conception  et  de  fonctionnement 
des  interfaces  entre  le  pilote  et  sa  machine. 

L’lntelligence  Artificielle  s'inscrit  dans  ce  mouvement  et  va  s'installer  a  bord  des  avions  d'armes.  Son 
apport  pourra  se  reveler  capital,  car  il  va  contribuer  a  deplacer  le  niveau  des  rapports  que  le  pilote  entretient 
avec  son  avion  et  constitper  un  veritable  copilote  electronique.  Celui-ci,  deja  capable  de  fournir  au  pilote  des 
informations  sur  les  differents  constituants  des  systemes  embarques,  sur  le  vehicule,  sur  le  monde  exterieur 
et  ses  composantes  favorables  ou  hostiles,  va  bientdt  pouvoir  raisonner  en  utilisant  ces  informations  et  assister 
le  pilote  en  lui  fournissant  en  outre  des  previsions  d'evolution,  des  conseils  sur  1'attitude  a  adopter... 

Ce  niveau  superieur  de  rapport  entre  I'homme  et  sa  machine  va  contribuer  a  l'efficacite  operationnelle 
de  1  ensemble.  C'est  l*une  des  voies  qui  permettront  de  faire  face  aux  situations  complexes  et  menafantes  que 
les  forces  aeriennes  auront  a  affronter  dans  les  annees  a  venir.  II  $era  envisageable  d'etendre  le  domaine  d'emploi 
des  avions  et  de  leurs  systemes  a  des  conditions  difficiles  telles  que  le  vol  a  tres  basse  altitude  et  a  grande 
vitesse,  I'attaque  de  nuit  et/ou  par  mauvais  temps,  le  combat  multi-cibles,  etc... 

Le  r61e  du  pilote  evoluera  mais  ses  facultes  seront  encore  mieux  mises  a  profit  pour  la  conduite  generale 
de  la  mission,  et  surtout,  pour  la  prise  de  decision  face  a  des  situations  imprevues.  Ce  qui  rendra  sa  place  dans 
la  machine  toujours  aussi  importante. 
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RESUME . 


L'extension  de  1 ' informat isation  a  bord  des  avions  de  combat  permet 
d’introduire  de  nouvelles  formes  d  '  interf  acres  pi  lote-machine  . 

L’archi  tecture  de  la  cabine  du  dEmonstrateur  RAFALF.  est  comjuc  a 
partir  de  ces  techniques.  Ainsi  l'angle  d ' incl inaison  superieur  a  30*  du  siege 
pilote.  destine  a  am&liorer  la  rEsistance  aux  facteurs  de  charge  eleves, 
entratne  des  consequences  importantes.  Parrni  ces  consequences  on  peut  citer  la 
position  tr4s  couch^e  du  pilote.  le  pilotage  par  Blanche  lateral.  la 
centralisation  des  coramandes  sur  clavier  multiplex^.  la  perte  de  1  ’  acces 
physique  a  la  majeure  partie  du  tableau  de  bord  qui  implique  la  necessity  do 
designer  des  Etiquettes  sur  les  ecrans  a  partir  d'un  "joy-stick". 

Avant  d'etre  complEtement  implantee  sur  RAFALE,  la  commande  vocale  a 
fait  l’objet  d'essais  en  vol  sur  MIRAGE  III  et  d'essais  en  simulation. 

D'une  maniere  generale.  on  peut  dire  que  ces  nouvelles  comotandes  sont 
techniquemen t  au  point  ou  en  passe  de  le  devenir  rapidement.  [.'experience  en 
vol  a  revele  que  les  consequences  de  la  position  tres  coucheo  du  pilote  sur  le 
confort  et  la  psychologie  etaient  bEnefiques.  con t rai remen t  aux  craintes  qu'on 
avait  pu  avoir.  En  revanche,  1  ' aspect  ergonomique  du  dialogue  a  v  e  c  les 
systemes  demande  encore  beaucoup  de  travail  de  la  part  des  equipes  chargees  do 
les  adapter  A  1  ’  uti 1 isat ion  opera t ionne 1 le . 

C'est  ainsi  qu'on  doit  e  viter  un  des  t ravers  classiques  de 
1  ’ i n f o rm a t i que  qui  conduit  a  une  surabondancc  d  '  informations  presentees,  ce 
qui  est  particulierement  facheux  a  bord  d'un  avion  dc  chnsse  ovi  les  faeult.os 
intellectuelles  du  pilote  decroissent  notablement  avec  la  difficulle  de  la 
mission.  Kn  revanche,  un  traitement  judicieux  de  1 ' i n f orma t  i  on  accessible  au 
systeme  doit  permettre  de  liber  e  r  le  pilote  de  la  plupart  des  analyses 
elementaires,  en  ne  lui  laissant  que  les  taches  nobles,  coirnne  le  choix  des 
options  tactiques ,  pour  lesquelles  il  est  i rromp] arable  dans  le  contexte  des 
operations  aeriennes. 


INTRODUCTION . 


Sup  les  avions  de  la  generation  du  MIRAGE  2000,  1 ' informatisation 
est  limit£e  au  systeme  d’arraes;  les  donnees  relatives  au  porteur  restent 
c 1  ass iquement  acheoin£es  par  des  r£seaux  cables  analogiques.  En  cabine.  on 
retrouve  une  discrimination  bien  marquee  entre  les  inst  rumen  ts  relatif s  au 
porteur  et  ceux  consacres  au  systeme  d’armement  et  de  navigation. 

D6sormais,  un  avion  d'arme  sera  un  ensemble  inf ormatique  coherent  ou 
chaque  element  qui  le  constitue  pourra  avoir  acces  a  1 1  ensemble  des 
informations  disponibles  4  bord.  En  cabine,  on  pourra  procfeder  £  une 
restructuration  complete  de  1  * archi tecture . 

Nous  allons  voir  que  le  demonstrateur  RAFALE  possede  ces 
caracteristiques  £  un  niveau  d£j£  tr£s  elev£.  La  coromande  vocale  avant  d'y 
etre  implantee  a  fait  l'objet  d'essais  etendus  en  simulation  et  en  vol. 

L ' util isation  au  cours  de  stances  d'essais  de  ces  systemes  nouveaux  a 
6te  menee  en  gardant  toujours  £  l’esprit  la  nature  des  contraintes  qu ' impose 
au  pilote  la  mission  opera tionnel le .  De  ces  experiences,  nous  pouvons  tirer 
des  enseignemen ts .  Nous  verrons  en  particulier  qu'un  systeme  techniquement  au 
point  ne  suffit  pas  forcement  £  remplir  une  mission  donnee  s'il  ne  pr£sente 
pas  de  surcroit  une  excellente  adaptation  aux  caracteristiques  humaines  bien 
par ticul i£res  d’un  pilote  de  combat  en  cours  de  mission. 


2.  LES  PRINCIPAUX  SYSTEMES  NOUVEAUX  UTILISES. 


2.1,  Architecture  de  la  cabine  du  RAFALE. 

Les  caracteristiques  aerodynamiques  en  conf iguration  d ' a t terrissage  ou 
d'appontage,  le  choix  du  type  de  siege  £jectable.  et  les  exigences  en  matiere 
de  visibility  vers  l’avant  fixent  £  priori  un  nombre  important  de  parametres 
g£om£triques  de  la  cabine.  Cependant.  1’angle  d ' incl inaison  du  si£ge,  qui  peut 
dtre  pris  dans  une  plage  assez  etendue,  constitue  le  choix  le  plus  determinant 
dans  1 ' architecture  du  poste  de  pilotage. 

La  resistance  du  pilote  au  facteur  de  charge  depend  en  particulier  de 
1 'angle  que  fait  son  dos  avec  le  vecteur  acceleration.  L' augmentation  de  cet 
angle  s’accompagne  de  consequences  importantes  sur  1 'organisation  de  la 
cabine:  perte  de  l'acc&s  physique  £  la  majeure  partie  du  tableau  de  bord. 
diminution  de  la  surface  de  ce  dernier,  necessity  de  piloter  avec  un  manche 
lateral,  perte  de  l'acces  facile  aux  banquettes  laterales.  Hormis  son  domaine 
de  f one tionnemen t  a  l'6jection,  la  limite  de  1 ' inc 1 inai son  du  si£ge  est  fixee 
par  1' apparition  des  genoux  du  pilote  dans  le  champ  visuel  en  approche.  Dans 
ce  cas,  la  surface  du  tableau  de  bord  est  evidemment  annulee. 

Le  choix  d'un  angle  superieur  £  30*  qui  a  ete  retenu  permec  de 

conserver  un  tableau  de  bord  capable  de  recevoir  deux  Visualisations  T£te 
Basse  (VTB)  non  accessibles  £  la  main  du  pilote.  Cette  derni£re 
carac t£ris tique  interdit  de  leur  associer  sur  le  pourtour  des  touches  de 
designation,  comme  on  en  trouve  par  exemple  sur  F  18. 

Cet  6cran  couleur  tete  basse  peut  presenter  dif ferentes  pages 
concernant  l'avion  ou  les  systemes.  Le  choix  des  pages  peut  se  faire  de 
diff£rentes  nanieres .  On  peut  designer  une  etiquette  par  une  alidade  pilotee 
par  "joy  stick",  on  peut  faire  defiler  les  pages  gr&ce  a  un  bouton  poussoir, 
on  peut  appeler  directement  en  cas  de  panne  la  page  correspondant  au  circuit 
concerne,  ou  encore  appeler  les  pages  par  commande  vocale.  Les  pannes  ou  les 
anomalies  sont  annoncees  par  un  Avertisseur  d'Alarmes  Vocal  (AdAV). 

Le  "joy  stick",  pilote  par  le  pouce  gauche,  fonctionne  classiquement 
selon  le  principe  d ' une  commande  en  vitesse. 

Le  Collimateur  Tete  Haute  (CTH),  monochrome  £  grand  champ,  presente  un 
ensemble  de  reticules  de  pilotage  directement  derives  de  ceux  du  MIRAGE  2000. 
Le  "joy  stick"  peut  conduire  l'alidade  dans  le  champ  de  la  VTH .  On  peut  ainsi 
designer  certains  reticules  et  les  modifier. 

Le  Collimateur  T£te  Moyenne  (CTM),  egalement  monochrome,  constitue  un 
prolongement  continu  du  CTH.  II  pourra  ainsi,  associe  £  un  capteur  TV  ou  FL1R, 
6tendre  vers  le  bas  le  champ  de  vision  du  pilote.  Ce  collimateur  peut 
presenter  comme  la  VTB  differences  pages  seiec tionn6es  de  mani£re  semblable. 

Sous  le  CTM.  se  trouve  le  Clavier  Multiplexe  (ClaM),  place  incline 
entre  les  genoux  du  pilote.  Ce  clavier  devient  le  poste  de  commande  de  chacune 
des  radios,  du  VOR  ILS,  des  centrales  £  inertie  lorsque  partant  de  la  page  de 
base  (le  "menu”),  on  enfonce  la  touche  correspondent  a  la  fonction  choisie. 


Le  manche  lateral  est  A  faibles  d6batteients .  II  comporte  de 
norabreuses  commandes  dites  "temps  reel".  Le  manche  et  la  manette  sont  con?us 
pour  un  pilotage  selon  le  concept  3  M  (Mains  sur  le  Manche  et  la  Manette)  dans 
toutes  les  phases  opArationnelles  du  vol.  Les  avant-bras  du  pilote  reposent 
sur  des  accoudoirs  rAglables. 

Une  manette  unique  commande  les  deux  moteurs.  On  peut  Aventuel lement 
dissocier  chaque  moteur  grace  a  sa  petite  manette  auxiliaire.  Cette  manette 
unique  comporte  sur  sa  surface  un  grand  nombre  de  commandes  "temps  reel”. 

Sur  les  banquettes  latArales  se  trouvent  des  commandes  secondaires  qui 
ne  sont  susceptibles  d'Atre  actionn^es  qu ' au  sol  ou  au  cours  de  phases  de  vol 
stabilises  sans  acceleration. 

Si  le  tableau  de  bord  principal  n1 est  pas  ac.'ssible,  il  a  etA 
cependant  possible  d’amAnager  deux  petites  surfaces  lat6rales  que  le  pilote 
peut  atteindre  de  la  main.  On  y  trouve  principalemen t  la  commande  de  s6curit6 
g6nerale  d'armement,  la  commande  de  manoeuvre  du  train  d ' at terrissage ,  des 
in terrupteurs  de  secours  de  commande  de  vol,  et  le  Poste  de  Modification  de 
ParamAtres  (PMP). 

Ce  poste  est  constituA  de  deux  oouronnes  concentriques .  La  couronne 
extArieure  permet  de  selectionner  le  paramAtre  4  modifier  (calage 
barome trique ,  but  de  navigation,  canal  radio),  la  couronne  interieure  permet 
de  faire  varier  le  paramAtre  choisi.  Le  compte  rendu  de  1 ' action  est  presents 
sur  la  VTH .  On  Avite  ainsi,  pour  lea  modifications  simples,  une  procedure  plus 
lourde  au  clavier  ou  au  "joy  stick". 

2.2  La  commande  vocale  A  mots  isolAs. 

AprAs  une  phase  d’essais  en  simulation,  ce  systAme  avait  Ate  implante 
sur  un  MIRAGE  III  R.  Il  comporte  trois  fonctions  essentielles : 

-  Les  annonces  et  les  alarmes.  Par  exemple,  "fin  de  transfert  de 
voilure”,  "incidence  trop  forte",  grAce  au  systAme  de  synthese 
vocale . 

-  La  r^ponse  A  des  questions.  Par  exemple,  "vitesse  ?",  "vitesse 
430  Kt" ,  grAce  au  systeme  de  reconnaissance  et  de  synthAse  vocale. 

-  L' action  sur  des  ordres.  Par  exemple,  " autocommande  !", 
"autocommande  embrayAe" .  et  embrayage  de  1 ' au tocommande . 

Ce  systeme  de  reconnaissance  monolocuteur  possAde  un  vocabulaire  de  22 
mots  isolAs  avec  des  temps  de  reponse  infArieurs  A  la  seconde .  L'ordre  ou  la 
question  doivent  Atre  formules  aprAs  un  appui  bref  sur  un  poussoir  avant  de 
prononcer  le  mot. 

L'apprentissage  s'effectue  3 ••  .  En  vol,  il  est  possible  de 

rAapprendre  un  mot  rAguliArement  mal  reconnu.  La  qualitA  de  l'apprentissage 
est  contrAlAe  par  un  test  de  reconnaissance. 

Le  systAme  de  reconnaissance  vocale  rend  compte  de  ce  qu’il  a  compris 
en  repetar.t  l'ordre  ou  la  question.  Pour  certains  ordres,  une  confirmation  est 
necessaire.  Par  exemple,  le  pilote  deraande  "la  tour  !",  le  systeme  repAte 
"la  tour",  le  pilote  confirrae  "go  et  la  frequence  de  la  tour  de  contrdle 

se  sAlectionne  sur  le  poste  et  s'affiche  sur  le  clavier  de  commande.  En  cas 
d' incomprehension,  un  des  diagnostics  suivants  peut  Atre  retourne: 
"trop  fort",  "trop  faible",  "trop  long",  "repetez". 


2.3  La  commande  vocale  A  mots  enchalnAs. 

Ce  systAme  a  ete  implante  sur  le  simulateur  d’Atude  MIRAGE  2000.  Il  a 
etA  essaye  dans  le  cadre  d'une  mission  classique  d’ interception  avec  usage  des 
diffArents  armements  et  systAmes. 

11  permet  de  commander: 

-  les  frAquences  des  postes  radio,  du  VOR  ILS,  du  TACAN,  du 

transpondeur , 

-  1'altitude  A  tenir  par  le  pilote  automatique, 

-  les  modes  du  SystAme  de  Navigation  et  d'Armement  (SNA), 

-  les  fonctions  du  viseur, 

-  les  Achelles  et  les  modes  de  fonctionnement  du  radar. 

Il  s'utilise  par  appui  bref  sur  un  poussoir  de  la  poignAe  pilote 
precedant  la  phase  de  parole.  Les  frequences  ou  les  canaux  des  postes  de  radio 
ou  de  radio  navigation  doivent  Atre  ApelAs  chiffre  par  chiffre. 

Le  vocabulaire  est  de  62  mots  e*  de  51  chaines. 

Le  retour  vocal  de  l’ordre  compris  par  la  machine  n’est  pas 
sys  tematique . 
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3.  RESULTATS  OBTENUS ,  COMMENTAI RES ,  EVOLUTIONS  SOUHAITABLES . 

3.0  A  quo!  sert  le  pilote  ? 

II  serait  ambitieux  de  vouloir  repondre  completement  en  quelques 
lignes  A  cette  question,  mais  il  n’est  pas  inutile  de  rappeler  ici  quelques 
points  importants. 

Dans  une  mission  operationnel le  ,  les  capacites  in  tel lec tue 1 les  d'un 
pilote  dAcroissent  d’autant  plus  que  les  conditions  du  vol  sont  difficiles: 
zone  hostile,  mauvaises  conditions  me tAoro logi ques ,  grande  vitesse,  basse 
altitude,  vol  de  nuit... 

L'intArAt  najeur  de  la  presence  de  1 ' element  humain  a  bord  de  1 1  avion 
reside  dans  sa  capacite  A  s'adapter  A  la  situation  du  moment,  a  effectuer  des 
Choix  tactiques  dans  un  contexte  qui  restait  a  priori  grandement  imprevisible 
avant  le  dAbut  de  1'action  elle-mAme. 

On  a  done  deux  rAalitAs  an t agoni s tes  .  D'une  part  la  puissance 
intellectuelle  affaiblie  du  pilote,  et  d1 autre  part  la  necessite  pour  lui 
d’analyser  une  situation  complexe  avant  de  procAder  A  des  decisions  tactiques 
qui  peuvent  souvent  avoir  des  consequences  Vitales.  11  faut  done  s' arranger 
pour  que  le  peu  de  capacity  d' analyse  et  de  jugement  qui  reste  au  pilote  soit 
exclusivement  consacrA  A  1'AxAcution  des  operations  qu'il  est  seul  A  pouvoir 
accomplir . 

Dans  ce  but,  un  avion  moderne  doit  possAder  deux  caracteris tiques 
fondamentales  en  ce  qui  concerne  1 ' organisation  de  sa  cabine : 

-  Automatisation  trAs  poussAe  de  la  gestion  de  l’avion  et  des  systAmes 
par  des  logiciels  "experts"  capables  d'effectuer  les  interpretations 
A1 Amen taires . 

-  Presentation  simple,  selon  des  schemas  proches  des  schemas  mentaux 
humains ,  des  elements  d ' inf ormation  dont  le  pilote  aura  besoin  pour 
eiaborer  ses  decisions. 

3-1  Position  de  pilotage. 

On  a  pu  craindre  que  la  position  de  pilotage  trAs  inclinee,  qui 
ressemble  A  la  position  que  l'on  a  dans  une  chaise  longue,  tendrait  A  emousser 
1‘ardeur  combative  du  pilote. 

En  rAalite  cette  position  entraine  une  augmentation  de  confort  trAs 
sensible,  en  particulier  sous  facteur  de  charge  dont  les  effets  nefastes  sont 
nettement  attAnuAs.  De  ce  fait  le  pilote  n'apprAhende  pas  les  evolutions 
soutenues  sous  forte  acceleration.  II  se  sent  naturellement  protAgA.  Ainsi  son 
agressivitA,  vertu  cardinale  chez  un  chasseur,  s'en  trouve  au  contraire 
consolidAe . 

Les  avant-bras  bien  tenus  par  les  accoudoirs  rAglables,  associAs  A  des 
lois  de  commandes  bien  adaptAes,  permettent  un  excellent  dosage  des  gestes  de 
pilotage.  Ces  derniers  sont  plus  precis  qu'avec  un  manche  classique  ou 
1' avant-bras  repose  le  plus  souvent  sur  la  cuisse  droite,  elle-mAme  revAtue 
d'un  pantalon  anti-g  qui  se  gonfle  ou  se  dAgonfle  au  grA  du  facteur  de  charge. 


3.2  Designation  des  etiquettes  dans  les  visualisations. 

La  perte  de  1'accAs  physique  A  la  majeure  partie  du  tableau  de  bord 
interdit  de  disposer  sur  le  pourtour  des  Acrans  de  VTB  des  touches  de 
designation  comme  e'est  le  cas  en  particulier  sur  F  18  ou  sur  les  FMS  des 
avions  de  transport.  Toutes  les  designations  d'Atiquettes  s'opArent  grAce  au 
"joy  stick"  qu'on  pilote  du  pouce  gauche. 

C'est  une  commande  dite  "en  vitesse",  e'est  A  dire  qu'A  un  dAplacement 
donn6  de  la  commande  correspond  une  vitesse  de  dAplacement  de  l'alidade. 
Celle-ci  peut  se  mouvoir  dans  les  trois  visualisations.  Elle  saute  d'une 
visualisation  A  l’autre  lorsqu'elle  atteint  une  limite  d’Acran. 

Rappelons  que  la  grande  majority  des  operations  possibles  par 
"joy  stick"  1'est  Agalement  par  un  autre  moyen ,  PMP,  clavier,  tourne-page, 
interrogation  sur  panne,  commande  vocale. 

On  peut  dire  que  le  pilotage  d'un  reticule  par  une  commande  en  vitesse 
n'est  pas  une  nouveautA.  On  trouve  ce  systAme  A  bord  des  avions  de  combat 
depuis  l'apparition  des  radars  embarquAs.  II  n'en  reste  pas  moins  que  ce  geste 
de  pilotage  demande  une  certaine  habiletA  de  la  part  du  man i pu 1  a teu r .  D' autre 
part  la  designation  elle  mArae ,  qui  s’opAre  par  appui  sur  le  "joy  stick", 
demande  un  geste  bien  vertical  si  on  ne  veut  pas  glisser  sur  l'etiquette  d’a- 
c6  tA  . 


Avec  1  '  habitude  ,  on  ne  se  rend  plus  compte  que  ces  operations 
mobilisent  tout  de  aSme  une  part  non  n£gligeable  de  l'attention.  Ceci  va  dans 
le  sens  de  1 '  accroissemer.t  de  la  charge  de  travail.  C'est  f&cheux. 

Une  commande  en  vitesse.  nfime  associ6e  6  des  lois  de  deplacement  tres 
bien  etudi6es.  ne  se  manipule  pas  aussi  facilement  qu'une  commande  dite  "en 
position" ,  ou  la  position  du  reticule  est  asservie  k  celle  de  la  commande.  La 
maniere  naturelle  de  modifier  la  position  d '  un  objet  est  bien  de  faire  dans 
l'espace  le  geste  qui  correspond  au  deplacement  souhaite.  La  "souris"  des 
micro-ordinateurs  est  une  commande  de  ce  genre.  Bien  entendu  on  1' imagine  mal 
directement  adaptee  A  une  cabine  d1 avion  de  combat.  Mais  il  en  existe  d'autres 
modeies . 

Par  exemple  la  boule  de  designation  qu'on  trouve  souvent  sur  les 
consoles  de  contrdle  de  la  circulation  a^rienne.  Elle  est  unanimement  reconnue 
comme  un  modeie  de  commande  en  position,  d'emploi  particulierement  aise.  On 
devrait  pouvoir  1 1  adapter  aux  cabines  d'avions.  II  faudrait  pour  cela 
concevoir  une  boule  semblable,  mais  de  taille  reduite,  qui  pourrait  ytre  logee 
dans  la  tete  d'une  manette  des  gaz  ou  d'une  poignee  pilote  dont  la  forme 
serait  adapt6e  A  1* usage  de  cet  accessoire. 

La  mise  au  point  d'une  telle  commande,  qui  remplacerait  tres 
avantageusement  les  "joy  sticks",  contribuerait  &  diminuer  la  charge  de 
travail  a  bord  des  avions.  Notons  ici  que  son  emploi  pourrait  s'6tendre  aux 
avions  de  tous  types.  II  y  a  la  pour  les  industriels  un  effort  technologique  h 
faire.  II  est  digne  d’int6r£t. 

3*3  Utilisation  du  clavier  multiplex^. 

Les  postes  de  commande  des  diffferents  yquipements  de  radio,  radio- 
navigation,  ou  de  navigation  k  inertie  sont  habi tuellemen t  disseminfes  dans  la 
cabine.  Ce  clavier  permet  de  les  placer  tous  k  l'endroit  le  plus  accessible  et 
le  mieux  en  vue . 

Cet  avantage  considerable  se  paie  d '  un  inconvenient:  il  faut 
configurer  le  clavier  avant  d'acc£der  au  poste  de  commande  souhaite.  Cet 
inconvenient  peut  etre  s6rieux,  voire  redhibi toi re ,  si  les  logiques  adoptees 
pour  les  touches  sont  mal  etudiees.  En  effet,  pour  chaque  poste  de  commande  il 
existe  plusieurs  niveaux  de  sous-pages.  Si  par  exemple  on  se  trouve  dans  la 
dernidre  sous-page  du  poste  de  commande  de  navigation  et  qu’il  faut  tres 
rapidement  changer  de  frequence  radio,  on  doit  pouvoir  reconfigurer 
immediatement  le  clavier  en  poste  de  commande  radio.  Or,  en  cours 
d ' utilisation ,  la  page  de  menu  n'est  plus  presentee. 

Cet  inconvenient  potentiel  du  ClaM  peut  etre  evite  de  deux  manieres. 
On  peut  faire  un  clavier  plus  grand  avec  une  page  do  menu  pr6sentee  en 
permanence,  mais  on  prend  alors  plus  de  place  en  cabine,  ce  qui  va  a 
1 ' encontre  d'un  des  buts  recherches.  Ou  bien  on  adopte  une  logique  de  touches 
telle  que  la  procedure  de  reconfiguration  puisse  s'6x6cuter  par  un  geste 
m^canique  du  pilote  sans  demander  la  moindre  r6flexion  de  sa  part.  Sur  le 
clavier  du  RAFALE,  quelle  que  soit  la  configuration  du  clavier,  un  appui 
rep6t6  sur  la  touche  sup^rieure  gauche  conduit  dans  tous  les  cas  k  la  page 
menu . 

Une  autre  difficulty  vient  des  regies  d’insertion.  La  question  est  de 
savoir  si  on  doit  insurer  les  paramytres  par  la  touche  appropriye  ("insert"  ou 
"enter"),  ou  bien  si  le  paramytre  doit  ytre  insyry  automat iquement  dys  qu’il 
atteint  un  format  qui  correspond  A  ce  qui  est  attendu.  Par  exemple  pour  entrer 
une  route,  disons  la  route  005.  on  peut  adopter  deux  logiques:  soit  f rapper  0- 
0-5  et  le  format  k  trois  chiffres  pour  une  route  ytant  atteint  la  valeur  est 
inserye,  soit  frapper  5  "insert".  La  myme  question  se  pose  pour  chaque 
paramytre  pouvant  ytre  frappy  sur  le  clavier. 

Cette  question  n'est  pas  nouvelle.  Elle  s'est  pos6e  lors  de  la 
cryation  des  postes  de  commande  de  navigation.  Les  r^ponses  qui  lui  ont  yty 
apportyes  n'ont  d'ailleurs  pas  toujours  yt§  trys  heureuses .  Leur  antyriority 
ne  justifie  pas  qu'on  les  reconduise  sur  les  nouveaux  avions.  Aujourd'hui  le 
dialogue  alphanumy rique  s'ytend  cons idy rablement  .  11  est  impyratif  de 

standardiser  et  d 1 homogyny iser  les  procydures  de  dialogue  par  clavier.  A  ce 
propos  on  peut  regretter  que  la  disposition  des  touches  des  claviers  embarquys 
soit  diffyrente  de  celle  de  toutes  les  calculettes  du  commerce  (la  ligne  123 
est  en  haut  au  lieu  d'ytre  en  bas).  Voiiy  un  cas  ou  un  automatisme  quotidien 
aurait  pu  ytre  exploity  et  ne  l’a  pas  yty. 

Ces  dytails  ne  sont  pas  anecdo tiques .  Une  accumulation  de  petites 
difficultys  de  dialogue  dont  aucune  n'est  ry dhibi toi re .  peut  finir  par  rendre 
les  ychanges  lourds  et  pynibles,  accaparant  inutilement  l'attention  du  pilote 
qui  nygligera  done  la  conduite  de  sa  mission.  Et  en  fin  de  compte  les 
consequences  opyrationnelles  sont  aussi  graves  que  si  les  performances  de 
l'avion  ou  du  radar  ytaient  insuf f isantes . 


3.4  Utilisation  du  Poste  de  Modification  de  Paramfctres. 

Cette  commande  d'aspect  exterieur  tres  simple,  deux  couronnes 
concentriques  dont  une  seule  graduee  ,  tres  accessible,  est  un  module  de 
facility  d ' utilisation .  On  s'y  adapte  ins tantanement . 

Ce  principe  est  A  retenir.  L'usage  d ' une  telle  commande  doit  etre 
rendu  possible  pour  la  modification  de  tous  les  parametres  simples,  qu'ils 
soient  lieo  --  «./■»*•  te-r  -  -  n*’  «yst^me  d’armes. 

3.5  Presentation  des  informations 

A  partir  du  moment  ou  1 '  in forma t ion  subit  un  traitement  avant  d'etre 
presentee  au  pilote,  ce  traitement  doit  effectuer  toutes  les  interpretations 
qu’il  est  possible  de  programmer. 

Ce  principe  peut  s’illustrer  par  un  exemple.  Sur  RAFALE,  lorsque  les 
reservoirs  de  voilure  sont  presque  vides,  et  que  1 1  avion  est  en  pique 
accentue  .  le  jaugeage  indique  "voilures  vides"  prtmaturement .  En  effet  la 
quantity  de  carburant  consommee  correspondent  a  cette  phase  du  transfert  n'est 
pas  encore  atteinte.  La  page  carburant  presentee  en  VTB  indique  alors  une 
anomalie  de  transfert  voilure.  On  a  la  un  traitement  incoraplet  de 
1 ‘ information  concernant  le  carburant  qui  n 1 apporte  pas  d'aide  au  pilote, 
puisque  ce  dernier  doit  tout  de  meme  se  livrer  a  une  interpretation .  Cette 
anomalie,  qui  sera  rapidement  corrigee.  montre  que  1' informatisation  n ' apporte 
une  aide  efficace  que  dans  la  mesure  ou  elle  est  capable  d'effectuer  elle  meme 
les  interpretations  sys teraatiques .  et  de  les  faire  completemen t . 

Ces  operations  concernent  la  security  de  1 1  avion .  C'est  pourquoi  la 
fiabilite  de  ces  logiciels  doit  etre  compatible  avec  1  ’  importance  des  taches 
qui  leur  sont  confiees. 

L'alarme  vooale  apporte  une  aide  considerable  si  elle  est  bien 
adaptee.  Elle  attire  beaucoup  1 'attention,  ce  qui  est  une  qualite.  mais  de  ce 
fait  on  ne  peut  pas  accepter  les  declenchements  intempes ti f s . 

Comme  le  syst^oe  est  riche  et  puissant,  il  peut  dire  et  ecrire 
beaucoup  de  choses  pour  chaque  cas  de  panne.  La  tendance  des  concepteurs  est 
de  donner  beaucoup  d  ’  informations .  Si  cette  information  ecri te  sur  les 
visualisations  et  enoncee  par  l’alarme  vocale  est  trop  abondante,  presentee 
sans  distinction  entre  ce  qui  est  une  annonce  et  ce  qui  est  une  consigne  a 
appliquer,  on  se  trouve  dans  une  situation  ou  une  bonne  partie  des  avantages 
du  systtme  est  perdue  a  cause  d'une  presentation  mal  adaptee.  peu  rigoureuse, 
et  plethorique . 

3.6  Commande  vocale 

L’  utilisation  en  vol  de  la  commande  vocale  associee  a  la  parole 
synthetique  (pour  le  systtme  £  mots  isoles),  ou  ratine  en  simulation  (pour  le 
systeme  A  mots  enchaines)  ,  montre  que  cet  outil  n'est  pas  une  panacee  mais 
qu'il  peut  rendre  de  tr£s  grands  services  s’il  est  utilise  dans  son  domaine  de 
pleine  efficacite. 

Pour  la  commande  a  mots  isoles,  on  peut  dire  que  la  technique  est  au 
point,  et  que  les  taux  de  reconnaissance  hors  facteur  de  charge  eleve  sont 
satisfaisants  pour  des  commandes  non  essentielles . 

La  reconnaissance  est  assez  bonne  pour  des  premiers  vols  .  Neanmcins  la 
prononciation  de  certains  mots  comme  "vitesse"  change  sensiblement  selon  la 
phase  de  vol.  Lots  de  1  '  apprentissage ,  periode  calme,  le  "e"  final  est  plus 
marque  qu’en  approche  finale,  periode  plus  intense.  C’est  a  ce  moment  ou  on  a 
le  plus  besoin  de  1 ' information  que  la  machine  ne  comprend  plus. 

Un  des  int£rets  evidents  de  la  commande  vocale,  auquel  on  pense 
d'emblee,  est  la  fourniture  d ' in  formations ,  ou  la  selection  de  fonctions 
d'armeirent,  au  cours  du  combat,  sous  facteur  de  charge,  pendant  que  le  regard 
reste  fixe  sur  1 ' ad ve rsai re .  Dans  ce  domaine,  les  resultats  sont  decevants.  En 
effet,  sous  facteur  de  charge,  si  la  comprehension  reste  a  peu  pres  constante 
jusque  vers  A  g,  elle  se  degrade  nettement  au  dessus .  A  6  g,  il  faut  plusieurs 
tentatives  pour  obtenir  une  comprehension  apres  avoir  essuye  plusieurs 
"moins  fort"  et  "repetez". 

Ce  probleme  ne  se  rencontre  pas  pour  les  changements  de  frequences 
radio  ou  de  radio  navigation  qui  ne  s'effectuent  en  general  pas  sous  facteur 
de  charge  Aleve.  Cette  fonction  est  int^ressante  car  elle  effectue  en  plus  un 
traitement  de  1 ’ information .  Elle  traduit  un  ordre  humanist  "LA  TOUR",  en 
valeur  numtrique  "268.10". 

Bien  que  le  vocabulaire  soit  limits,  il  arrive  que  le  pilote  ait  du 
mal  A  retrouver  le  mot  correspondant  a  la  fonction  qu'il  souhaite .  En  essais. 
il  peut  sortir  son  lexique.  C’est  alors  une  demonstration  d ' i ne f f i caci te .  En 
operations  il  devrait  pouvoir  utiliser  des  synonymes . 


En  ce  qui  concerne  la  commands  k  mots  enchain£s  telle  qu’elle  a  6te 
essay^e  en  simulation,  l‘6tat  de  mise  au  point  6tait  beaucoup  ooins 
sat isf aisant . 

Le  principe  de  base  d 1  utilisation  -  appui  bref  sur  la  commande 
d'ouverture  de  micro,  puis  parole  -  ne  correspond  pas  aux  automatismes 
habituels  acquis  avec  les  radios  de  bord.  Ce  syst^me  conduit  souvent  k  ne  plus 
savoir  oti  en  est  la  reconnaissance,  si  on  peut  poursuivre  la  locution,  si  on 
doit  reprendre  k  zkro,  ou  si  on  doit  dire  "effacez" . 

La  modification  qui  autorise  l'appui  permanent  a  6t£  grc*f£e  sur  ce 
syst^me  mais  ne  constitue  pas  une  veritable  commande  k  appui  permanent.  En 
parciculier,  une  interruption  moyenne,  (entre  0,2  et  2  s)  est  souvent  suivie 
d ' une  incomprehension. 

La  reconnaissance  est  beaucoup  plus  mauvaise  que  pour  les  mots  isol6s. 
On  bute  par  moments  sur  telle  ou  telle  expression,  puis  cela  s' arrange  alors 
que  la  prononciation  parait  constante.  S'il  y  a  des  difficulty  avec  un  mot 
donn&,  il  faut  rfeapprendre  toutes  les  chaines  qui  le  contiennent . 

On  a  rapidement  vu  les  dangers  d'un  systdme  sans  compte-rendu 
syst^matique :  en  cas  de  confusion,  on  ne  sait  pas  ce  qu '  a  fait  la  commande. 
Ceci  pourrait  avoir  de  graves  consequences! 

Le  vocabulaire  est  k  1  '  Evidence  trop  6tendu  pour  la  capacite  de 
memoire  d'un  pilote  en  vol.  Les  stances  se  font  le  lexique  a  la  main. 

En  particulier,  l'affichage  d ' une  frequence  V.O.R.  en  fepelant  chiffre 
par  chiffre  est  une  charge  de  travail  nettement  plus  lourde  qu’un  affichage 
manuel.  De  plus,  la  prononciation  des  chiffres  varie  beaucoup  suivant  leur 
position  dans  la  chaine  lors  d’une  prononciation  courante;  il  faut  done 
adopter  une  prononciation  tr£s  peu  naturelle,  ce  qui  est  Irks  p^nalisant.  En 
revanche  si  on  pouvait  dire  "VOR  NEVERS"  .  il  y  aurait  un  b6n6fice 
considerable.  On  retrouve  lk  l'intferftt  que  pr6sente  la  commande  vocale  si  elle 
permet  d’humaniser  davantage  la  cabine. 

Souvent,  on  ne  trouve  pas  d'emblee  la  locution  exacte  pour  obtenir  un 
rfesultat,  mais  son  synonyme.  Par  exemple  on  demande  "viseur  approche"  ou  bien 
"passer  approche"  pour  "select  approche". 

Il  faut  r£duire  les  actions  possibles  et  utiliser  la  vaste  capacite  de 
memoire  pour  l'eraploi  de  synonymes . 


4.  CONCLUSION. 


L’ informatisation  generalise  des  avions  de  combat  rend 
possible  des  architectures  de  cabine  et  des  systemes  de  commande  rad icalement 
nouveaux . 

Dans  ces  interfaces  nouvelles,  1  *  information  qui  est  echangee  entre  le 
pilote  et  la  machine  peut  subir  des  traitements  et  prendre  des  formes 
extrSmement  vari6s. 

Le  champ  possible  de  ces  traitements  et  de  ces  formes  est  presque 
illimite  t echn i quemen t . 

L'exp6rience  de  1 ' u t il isation  de  certains  de  ces  Elements,  4crans. 
claviers,  commande  vocale,  montre  que  e'est  1 'adaptation  ergonomique,  au  sens 
physique  et  surtout  mental  qui  manque  le  plus  souvent  de  mise  au  point. 

Il  faut  en  conclure  que  les  travaux  k  venir  aevront  teire  appex  pour 
une  trks  large  part  aux  avis  des  principaux  int6ress6s.  les  pilotes.  De  leur 
c6t6,  ces  derniers  devront  faire  l'effort  d' analyser  rigou reusemen t  ce  qu'est 
leur  compor  tement  ,  et  ce  dont  ils  ont  besoin  au  cours  d  ’  une  mission 
op&rat ionnel le .  De  cette  analyse  devraient  d6couler  les  elements  dont  ont 
besoin  les  cons  true teurs  pour  donner  aux  ^changes  entre  le  pilote  et  son  avion 
des  formes  bien  appropri6es. 
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is  paper  describes  some  of  the  fundamental  performance  and  design  parameters  that  should  be 
ered  for  the  successful  evolution  and  integration  of  a  new  type  of  helmet  mounted  display  (HMD) 
intended  for  use  in  military  aircraft  cockpits/simulators.  It  is  called  3  virtual  panoramic 
y  (VPD).  The  parameters  discussed  include  f ie Id-of-v iew  (FOV),  exit  pupil,  image  quality,  eye 
,  collimation,  alignment,  size,  weight,  system  integration  issues,  and  several  others.  For  the 
time  the  associated  helmet  system  is  considered  as  an  integral  subsystem  that  must  be  designed  to 
t  the  requirements  of  the  HMD.  Trade-offs  relating  to  the  intended  VPD  applications  (i.e., 
t  simu lators/ rotary  wing  aircraft),  HMD  design  and  its  impact  on  the  associated  image  source  and 
y  electronics  are  discussed.  Design  issues  and  considerations  are  developed  primari ly  from  the 
int  of  the  VPD  system  integrator. 


A  virtual  panoramic  display  (VPD)  is  a  subset  of  helmet-mounted  display  systems  (systems  being  a 
key  word)  that  provides  the  pilot  or  operator  with  a  large  instantaneous  field-of-view,  whose  displayed 
information  has  been  organized  both  temporally  and  spatially  to  maximize  the  effectiveness  of  the 
man/machine  interface  and,  therefore,  maximize  operat ional/situat ion  awareness  1 05 J .  The  VPD  system 
concept  seeks  to  optimize  its  electronic  interfaces  ith  the  aircraft  or  simulator  system  and  the 
human's  cognitive  and  sensory  systems.  The  concept  oecomes  an  application-specific  design  problem 
involving  not  only  the  VPD  hardware  it9elf,  but  the  design  and  operational  spec i f icat ions  of  all  other 
hardware  subsystems  with  which  it  must  be  interfaced.  In  this  paper,  discussion  will  include  only  the 
VPD  visual  subsystem  hardware  whose  major  components  are  outlined  by  the  heavy  dotted  line  in  Figure  1, 
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FIGURE  l 

GENERIC  VPD  SYSTEM  HARDWARE  BLOCn  DIAGRAM 

stem  includes  a  binocular  display  whose  visual  fields  are  either  fully  ot 
rraitting,  if  desired,  the  presentation  of  stereoscopic  images.  The  binocular 
iature  cathode-ray-tubes  (CRTs)  of  an  advance d  design.  The  optics  and  CRTs  are 
helmet  system.  The  CRTs  are  interfaced  to  specially  designed  analog  helmet  - 
ics  which  "tailor"  the  displayed  information  to  the  requirements  of  both  the 
The  analog  display  electronics  accepts  inputs  from  both  external  system 
erated  graphics  systems,  as  well  as  a  VPD  graphics  processor  that  supplies 
stomized,  interactive  symbology  and  graphics.  The  VPD  graphics  processor  nav  ir 
given  VPD  system  configuration.  Because  the  graphics  processor's  impact  on  the 
is  minimal,  its  functions  will  not  be  discussed  further. 


As  shown  in  Figure  2,  the  head  mounted  CRTs  must  image  their  visual  information  through  a  set  of 
relay  optics,  which  may  use  fiber  optics  and/or  conventional  refractive  element */pri sms. 'mit rors .  A 
combiner  or  combiner /beamspl itter  arrangement  that  may  or  may  not  be  part  of  the  helmet  visor,  reflects 
light  from  the  CRT  and  transmits  the  outside  scene.  The  CRTs  and  optics  are  part  of  an  integrated 
helmet  system  (IHS)  that  maximizes  optical  system  stabi li ty/funct ional itv  on  the  head,  minimizes 
modifications  to  the  helmet/head  weight  md  center-of-gravity  (CC),  and  protects  the  wearer  from 


hostile  ambient  environments.  To  accomplish  these  functions,  the  IHS  design  must  use  advanced 
materials  and  structures,  and  optimize  adjustment  and  alignment  hardware  and  earphone /microphone • 
oxygen  mask  components. 

DISPLAY 

BEAMSPLITTERS 

AND/OR 


FIGURE  2 

VPD  HEAD/VISUAL  SYSTEM  RELATIONSHIPS 

This  paper  is  concerned  primarily  with  simulator  and  rotary  wing  aircraft  applications,  and 
therefore,  the  breadth  of  discussion  is  somewhat  specialized,  although  much  can  be  inferred  concerning 
the  design  of  such  systems  for  other  types  of  aircraft.  Before  discussing  design  considerations,  it  is 
worth  noting  why  a  binocular  head  mounted  display  system  was  selected,  instead  of  a  cockpit  mounted 
system,  where  weight/size  limitations  are  not  nearly  as  severe.  As  Figure  3  shows,  there  are  a  number 
of  design  alternatives  for  a  wide  FOV  cockpit  display  system.  A  major  goal  of  the  VPD  was  to  maximize 
situation  awareness  regardless  of  the  operator's  l ine-of-s i ght  (LOS).  This  can  be  accomplished  either 
with  a  reduced  instantaneous  FOV  display  that  is  head  mounted  and  updated  rapidly,  based  upon  head 
orientation  and  position,  or  with  an  extremely  large  instantaneous  FOV  display  that  is  eockpi t -mount ed . 

VPD  SYSTEM 


FIGURE  3 

VPD  DESIGN  ALTERNATIVES 

The  choice  bet'-'een  these  major  design  alternatives  was  limited  by  a  number  of  performance  and 
technology  issues.  During  the  early  design  stages  of  the  VPD  program,  it  was  decided  that  stereoscopic 
cues  (using  visual  disparity  between  the  two  eyes)  might  aid  the  operator  in  ordering  the  relative 
importance  of  critical  display  information.  From  either  a  cost  or  performance  viewpoint,  current 
technology  does  not  permit  construction  of  either  a  cockpit-mounted  or  a  combination  cockpit/head 
mounted  system  providing  the  above  features,  therefore  these  were  eliminated  from  consideration. 
Further,  a  wide  FOV  head-mounted  display  system  utilizing  a  remote  image  source,  coupled  to  the  head, 


using  either  re  ractive  or  fiber  optic  image  conduits,  suffers  from  a  number  of  severe  design  problems, 
including  red’  :ed  display  resolution/contrast,  the  possibility  of  excessively  rigid  and  heavy  optical 
conduits  bet'.een  the  head  and  cockpit,  and  stray  light.  Therefore,  a  display  configuration  including 
head  mounted  optics  and  image  sources  is  the  only  alternative  considered  here.  The  reader  should  also 
note  that,  for  the  remainder  of  this  paper,  the  terra  helmet  mounted  display  (HMD)  will  be  used 
interchangeably  with  VPD  when  referring  to  the  helmet  mounted  components. 

VPD  DESIGN  CONSIDERATIONS 

OPTICS 

Textbooks  and  engineering  handbooks  list  many  design  parameters  and  attempt  to  specify  and 
organize  design  parameters  associated  with  optical  systems,  including  helmet  mounted  displays  (HMDs). 
Table  1  depicts  a  representative  list  of  parameters  and  generalized  numerical  f i gures-of-me r i t  (FOM) 
for  each  parameter.  However,  HMD  design  is  tightly  coupled  to  the  intended  application,  and  the  use  of 
a  generalized  table  of  parameter  values  or  generalized  design  approach  will  not  usually  lead  to 
satisfactory  results.  The  relevant  technical  literature  also  provides  scant  help,  and  there  are  many 
large  gaps  in  applied  research  that,  if  available,  might  provide  for  better  organization  of  the  design 
approach.  One  must,  then,  gather  as  much  information  as  possible  about  the  intended  application  and 
system  interfaces,  and  hope  that  the  available  technology  will  support  the  development  of  an  adequate 
design. 


TABLE  1 

HMD  OPTICAL  SYSTEM  DESIGN  PARAMETERS 


QUANTITY 

TYPICAL  RANGE 

TOLERANCE 

FIELD-OF-VIEW  (INSTANTANEOUS) 

70“  TO  120“  HOR  X  30“  TO  60“  VER 

NA 

PUPIL  SIZE 

HELMET  MOUNTED 

10  TO  23  MM 

±  1 

EYE  RELIEF 

HELMET  MOUNTED 

35  TO  45  MM 

±3 

FOCAL  LENGTH 

10  TO  30  MM 

NA 

f NUMBER 

0.7  TO  2.0 

±.2 

CONTRAST  RATIO  (APPARENT) 

0.2  TO  0.80 

±0.1 

DISTORTION 

0.2  TO  5% 

±1 

ASTIGMATISM 

0.1  TO  1  DIOPTER 

±.1 

CHROMATIC  ABERRATION 

1  TO  6  ARC  MIN 

±  1 

COLOR 

B/W  TO  FULL  COLOR 

NA 

CONVERGENCE 

1  TO  30  ARC  MIN 

±  1 

DIVERGENCE 

1  TO  3  ARC  MIN 

±  1 

DIPVERGENCE 

1  TO  15  ARC  MIN 

±3 

DISPLAY  REFRESH 

60  TO  240  FIELDS/SEC 

Nm 

To  proceed  with  the  necessary  system  analysis,  which  organizes  the  relationship  of  the  available 
technology  to  ^he  requirements  of  a  specific  application,  one  must  arrange  the  parameters  listed  in 
Table  1  in  order  of  importance.  Due  to  the  lack  of  definitive  guideline’s,  this  ordering  is  often  based 
upon  experience  with  current  similar  systems.  However,  the  choices  are  complex,  because  of  the  various 
possibilities  of  constraining  the  types  of  displayed  information  for  a  given  set  of  environmental 
conditions,  and  then  mixing/matching  display  components  to  support  those  constraints.  An  example  of 
such  a  scenario,  of  which  there  are  many,  is  as  follows: 

a)  Require  that,  during  the  high  ambient  luminance  of  daylight  VPD  operation,  the  display  be 
limited  to  portraying  vector  graphic  stroke  information.  It  can  he  refreshed  at  higher  rates  and  at 
wider  line  widths  than  raster  information,  to  obtain  maximum  luminance  contrast.  This  stroke-written 
information  is  then  ovcrlayed  on  the  ambient  scene  background  using  a  see-through  display  combiner. 

b)  During  night  or  low  ambient  luminance  conditions,  permit  the  display  of  sensor  or  computer 
generated  raster  information  with  adequate  contrast  at  lower  maximum  luminance  levels.  The  normal 
ambient  scene  would  then  be  replaced  with  a  sensor-produce^  reproduct  ion. 

The  underlying  issue  of  this  example  is  that  display  contrast,  and  therefore,  the  human  operator's 
ability  to  see/use  the  informat  ion  being  delivered  to  him  either  day  or  night  can  be  considered  as  one 
choice  for  the  most  important  design  parameter.  Thi s  contrast  parameter,  then,  drives  all  others  in 
system  designs  that  are  ultimately  evolved  and  built. 

Figure  '*  depicts  the  principle  design  categories  of  optical  systems  that  might  be  p*  loited  t  o 
implement  a  collimated  optical  design  suitable  for  use  in  a  VPD.  These  categories  are  delineated  bv 
the  system's  primary  basic  operating  principle,  realizing  that  a  particular  design  will  combine  more 


m 


chan  one  principle  to  maximize  performance.  For  the  VPD  systems  covered  in  this  paper,  only  system 
types  1  through  A  were  finally  considered  for  hardware  imp lementat ion. 
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FIGURE  4 

MAJOR  DESIGN  ALTERNATIVES  FOR  COLLIMATED  HMD a 

The  design  process  is  extensively  modified,  however,  by  the  display  hardware  system's  operating 
modalities.  These  might  range  from  a  system  that  must  perform  throughout  the  range  of  ambient 
conditions,  to  a  design  that  will  permit  alteration  of  some  of  its  components  to  match  its  performance 
to  the  extremes  of  the  operating  environment.  Two  separate  designs,  meant  to  accommodate  separate 
portions  of  the  environmental  parameter  ranges  might  also  be  reasonable.  Given  the  many  varied 
operational  configurations  for  the  VPD,  only  the  more  significant  configurations  and  their  associated 
performance  are  discussed  in  this  paper. 

Table  2  lists  the  systems  and  approximate  values  for  some  of  the  more  important  characteristics  of 
each  of  the  VPD  HMD  optical  designs,  for  which  working  helmet  systvm  breadboards  were  fabricated. 
System  1  using  a  special  version  of  the  Farrand  Pancake  Window,  employs  a  unique  combiner  design  to 
obtain  extremely  large  instantaneous  FOVs,  albeit  at  the  extreme  sacrifice  of  light  transmission 
efficiency.  Systems  2  and  3  are  catadioptric  systems  using  a  corabiner/beamspl i tter  combination  to 
obtain  large  FOVs  with  reduced  weight  and  improved,  but  still  low,  light  transmission  efficiency. 
Systems  4  and  5  are  essentially  refractive  optical  systems,  using  either  a  holographic  or  aspheric 
combiner  mirror,  that  can  provide  very  good  light  transmission  efficiency,  but  with  increased  weight 
for  FOVs  comparable  to  systems  2  and  3.  This  summary  is  presented  here  so  that  the  reader  may  be 
familiar  with  and  reference  this  table  as  the  VPD  design  considerations  are  enumerated  and  explained 
throughout  the  remainder  of  this  paper. 

TABLE  2 

VPD  HMD  OPTICAL  SYSTEM  CHARACTERISTICS  SUMMARY 


CHARACTERISTICS 

SYSTEM  3 

SYSTEM  4 

SYSTEM  5 

FARRAND 

PANCAKE 

WINDOW 

O.D.S. 

CATA¬ 

DIOPTRIC 

FARRAND 

DUAL 

MIRROR 

HUGHES 

HOLO¬ 

GRAPHIC 

FARRAND 

OFF 

APERTURE 

EXIT  PUPIL  imm) 

19 

21 

15 

15H  X  10V 

17/15 

MONO  FOV  (DEG) 

BOH  x  60V 

53H  x  40V 

60H  *  45V 

6 OH  X  30V 

50H  x  37  5V 

TOTAL  HOR  FOV  (DEG) 

120 

76 

90 

80 

70 

OVERLAP  (DEG) 

40 

30 

30 

40 

30 

EYE  RELIEF  (mm) 

39 

72 

32 

90 

60 

POLYCHROMATIC 

NO 

NO 

YES 

NO 

NO 

CRT  TO  EYE  TRANSMISSION 

00lCf 

0  25Cf 

0  06C, 

0  9Cf 

SEE-THROUGH  TRANSMISSION 

0.08C, 

0.5C, 

0  5C, 

C. 

c, 

APPROX  WEIGHT  OF  OPTICS  ASSEM  igm) 

490/LEG 

250/LEG 

210/LEG 

350  LEG 

460/  LEG 

INPUT  FORMAT  HOR  (mm) 

19 

16 

19 

19 

16 

EFL  (mm) 

13.6 

169 

18  1 

18  1 

17  2 

Cr  =  COMBINER  REFLECTANCE 
C,  -  COMBINER  TRANSMISSION 


SIZE  OF  FI ELD -OF -VIEW  (FOV) 


Selecting  this  parameter  is  often  the  single  most  important  decision  that  the  system  designer  or 
integrator  must  make.  It  can  have  a  major  impact  on  the  maximum  obtainable  display  combiner  contrast 


for  a  desired  ambient  transmission  condition.  Large  FOVs  mean  more  head-supported  weight,  and 
unacceptable  modification  of  the  military  headgear  center-of-gravity  (CG),  lesa  light  transmission 
efficiency  from  the  image-aource-to-eye  (ISTE),  and,  ultimately,  more  severe  performance  requirements 
for  the  image  source  and  its  associated  display  electronics.  Designers  must  usually  place  greatest 
weight  on  the  primary  application  for  the  system.  If  the  display  system  is  intended  for  ground-based 
use  in  simulators  or  other  similar  functions,  then  the  designer  may  opt  for  the  largest  practical  FOV. 
Large  FOVs  create  a  panoramic  visual  input  and  a  feeling  of  being  inmersed  in  the  environment  or 
situation  being  depicted.  However,  operational  field  use,  particularly  military  cockpits,  places  a 
premium  on  low  weight,  compactness,  maintenance  of  vision  to  the  ambient  background  under  all  head 
movement  and  aircraft  acceleration  conditions,  usable  contrast  for  both  the  displayed  and  ambient 
visual  stimulus,  and  survivability  in  hostile  environments .  These  considerations  drive  HMD  designs 
toward  smaller  FOVs. 

Figure  5  depicts  the  total  instantaneous  FOV  for  the  human  binocular  visual  system,  over  which  the 
instantaneous  display  FOV  for  one  of  the  largest  binocular  HMDs  ever  built,  has  been  drawn.  It  is 
immediately  apparent  that  the  instantaneous  display  FOV  (120  degrees  horizontal  by  60  degrees  vertical) 
is  much  smaller  than  that  for  unaided  eyes,  yet  the  display  system  needed  to  achieve  such  performance 
is  already  too  heavy  for  general  use  in  operational  rotary  wing  aircraft.  It  also  suffers  from  very 
low  ISTE  transmission  efficiency,  and  thus  either  very  poor  see-through  capability,  and/or  very  low  CRT 
contrast.  In  additional,  the  monoculars  have  been  turned  out,  allowing  only  the  overlapping  central 
forty  degrees  of  horizontal  FOV  to  be  seen  by  both  eyes.  This  places  severe  constraints  on  both  the  use 
of  the  optical  design  [01,20]  and  image  source  performance  l 18 ) . 


FIGURE  5 

RELATIONSHIP  OF  HHD/EYB  FOV 

Binocular  optical  designs,  particularly  those  employing  partial  overlap  of  their  monocular  FOVs, 
demand  compatible  mapping  schemes  for  the  display  system's  resolution  elements  across  their  angular 
FOVs  [20] .  For  VPD  optical  designs,  this  usually  means  that  F-theta  mapping  is  the  preferred  mapping 
scheme  (where  the  angular  distribution  of  resolution  elements  becomes  uniform),  rather  than  F-tangent 
theta  or  even  F-sine  theta  mapping  (where  there  are  excess  angular  resolution  elements  at  the  edges  of 
the  field).  For  partially  overlapped  systems,  F-theta  mapping  offers  the  only  practical  solution  to 
matching  resolution  elements  for  the  same  object  at  the  edge  of  one  eye/display  monocular  field  to 
those  that  will  be  at  an  alternate,  interior  location  to  the  field  for  the  other  eye/display  monocular 
viewing  the  same  object.  F-theta  mapping  also  eases  the  difficulty  of  the  optical  design  process, 
allowing  larger  exit  pupil  sizes  to  be  obtained  for  a  given  FOV  [02,03].  If  a  full  overlap  condition 
is  used,  it  might  be  desirable  to  introduce  spline  distortion.  For  this  type  of  mapping,  more  of  the 
resolution  elements  are  located  in  the  center  of  the  display  FOV  than  on  the  edge,  thus  approximating 
more  closely,  the  foveal/peripheral  topology  of  the  eye's  resolution. 

For  the  conditions  shown  in  Figure  5,  the  inboard  -40  degree  off-axis  location  for  the  right  eye 
monocular,  represents  the  0.0  degree  location  on  the  left  eye  monocular.  The  implication  of  this  fact 
for  the  image  source,  is  that  off-axis  performance  must  be  very  similar  to  on-axis  performance,  as  the 
central  viewing  portion  of  the  display  represents  an  off-center  viewing  location  on  the  CRT,  as  shown 
in  Figure  6.  Further,  to  properly  align  the  display  formats  for  the  eyes,  as  well  as  compensate  for 
residual  optical  distortion,  the  CRT  image  source,  must  have  its  imagery  predistorted  to  obtain  proper 
perspective  and  overlay  of  the  left  and  right  eye  display  images.  This  is  one  reason  why  CRTs  are  the 
image  source  of  choice  over  solid  state  image  sources,  because  their  resolution  can  be  altered  or 
mapped  and  is  not  constrained  to  the  fixed  patterns,  positions  and  sizes  of  solid  state  image  source 


resolution  elements.  Display  resolution  and  addressability  issues  relating  to  the  use  of  HMDs  in 
vibrating  environments,  may  also  be  used  as  part  of  the  total  system  analysis,  but  these  considerations 
play  a  much  more  Important  rale  in  vertical  FOV  selection. 
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FIGURE  6 

CRT  FORMAT  FOR  PARTIALLY  OVERLAPPED  WIDE  FOV  OPTICAL  DBS ICR 

Another  important  circumstance,  affecting  FOV  selection,  is  the  frequently  levied  requirement  to 
have  the  sensor's  FOV  displayed  in  a  direct  1-1  mapping  on  the  HMD  FOV.  An  example,  is  a  FLIR  system 
with  a  50  degree  horizontal  by  37.5  degree  vertical  FOV,  which  must  have  the  same  apparent  FOV  when 
presented  on  the  HMD.  A  requirement  of  this  type  for  a  panel  mounted  presentation  would  clearly  be 
waived,  because  the  resulting  cockpit  mounted  display  would  be  unacceptably  large.  Such  a  design 
requirement  is  feasible  for  the  HMD  which  can  have  an  angular  subtense  to  the  eye  (apparent  FOV)  this 
large  [22].  Further,  if  the  display  of  more  than  one  sensor  input  is  required,  and  their  associated 
FOVs  are  quite  different,  but  their  scan  formats  are  similar,  as  is  usually  the  case,  then  a  primary 
sensor  (normally  the  one  used  for  pilotage  tasks)  must  be  chosen.  The  display  FOV  is  then  selected  to 
accommodate  1-1  mapping  of  the  primary  sensor's  FOV.  Display  magnification  (or  rainification)  must 
usually  be  accepted  in  analog  systems,  for  the  display  of  other  sensors'  information,  because  the 
dynamic  range  of  the  image  source  cannot  usually  support  l-l  mapping  of  all  sensor  presentations. 

Having  accepted  this  criteria,  one  must  determine  its  impact.  Setting  aside,  for  the  moment, 
sensor/display  system  design  issues,  the  major  design  cons iderat ions  become  the  scanning  format,  the 
number  of  pixel  elements  spread  over  the  HMD  FOV,  and  the  scan  format/pixel  rate  capability  of  the 
image  source.  A  hypothetical  set  of  sensor/HMD  conditions  i9  depicted  in  Figures  7a  and  7b.  In  this 
example,  a  4:3  aspect,  50  x  37.5  degree  sensor  FOV,  with  750  visible  scan  lines  and  approximately 
square  pixels,  is  to  be  presented  using  a  1-1  mapping  of  sensor-to-display  resolution  elements  on  the 
HMD.  Assuming  nighttime  utilization  of  this  9ensor  format  and  a  aee-through  combiner,  then  the  image 
source  can  be  run  at  mode9t  luminance  conditions.  For  these  conditions  miniature  CRTs  can  achieve  500 
cycle  (1000  pixels)  per  display  width.  Since  the  example  sensor  is  providing  1000  pixels  per  line  for 
simultaneous  display,  its  format  and  the  capabilities  of  the  CRT  image  source  dictate  the  mapping  of 
resolution  elements  and  ultimately  the  conditions  for  maximum  HMD  FOV.  The  two  example  conditions  are 
diagrammed  in  Figure  7. 

For  the  conditions  shown  in  both  7a  and  7b,  the  mapping  of  resolution  elements  reflects  that  of  the 
sensor,  while  the  overlap  condition  and  the  total  number  of  sensor  pixels  displayed  by  the  right  and 
left  eye  image  sources,  has  been  changed  to  achieve  different  binocular  horizontal  FOVs  for  the  HMD. 
Area  ABCD  for  both  figures  indicates  the  entire  binocular  FOV  that  the  CRT's  addressability/ 
resolution  performance  can  support,  given  the  requirement  for  1-1  mapping  of  the  9ensor  FOV  onto  the 
HMD  FOV.  Area  WXYZ  represents  possible  overlap  conditions  that  the  HMD  CRTs  can  support  for  the  given 
total  sensor  resolution  and  the  tota l /over lap  FOVs  for  the  HMD.  Areas  RWZU  and  XSTY  represent  the 
remainder  of  the  Bensor  presentation,  which  can  be  seen  by  only  the  right  or  left  eye.  Areas  ARUD  and 
SBCT  represent  the  remaining  display  FOV,  which  the  CRT's  resolution/addressability  performance  can 
support  for  the  stated  drive  conditions. 

In  those  portions  of  the  instantaneous  display  FOV,  where  sensor  information  is  not  displayed, 
additional  peripheral  motion/reference  cues,  such  as  artificial  horizon  lines,  heading  tapes,  etc., 
might  be  drawn  during  the  video  vertical  retrace  interval,  if  vector  graphic  stroke  symbology 
capability  is  present.  Which  FOV  condition  is  designed  into  the  HMD  is  application-dependent,  although 
the  preponderance  of  the  sparse  human  factors  data  on  this  topic  seems  to  indicate  that  maximum 
performance  benefits  occur  at  50-60  degrees,  increasing  at  a  much  reduced  rate  for  still  larger  FOVs 
[13]. 
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FIGURE  7 

SC AH  FORMAT  RELATIONSHIPS  FOR  HYPOTHETICAL  SENSOR/HMD  COMBINATION 

A  complementary  approach  to  establishing  horizontal  FOV  allowing  direct  analytical  calculation  is 

to  base  the  FOV  determination  on  the  overall  system  resolution  (161.  The  relationship  shown  in 

equation  1,  relates  resolution  performance  of  the  miniature  CRT  image  source  and  the  addressable 
resolution  elements  available  from  a  given  imaging  sensor.  These  relationships  may  be  combined  to 
calculate  the  desired  horizontal  FOV  for  l-l  mapping  of  the  sensor  FOV  on  the  HMD.  Using  equation  I 
and  the  assumed  CRT/sensor  performance,  the  desired  horizontal  FOV  of  the  se..sor  display  is  50  degrees. 

Completing  the  determination  of  the  maximum  display  binocular  FOV,  then  reduces  to  computing  the 
amount  of  binocular  overlap  that  is  attainable.  This  can  be  computed  using  the  relationship  shown  in 

equation  2  1161.  Using  equation  2,  one  computes  an  overlap  FOV  of  40  degrees.  The  computed  horizontal 

and  overlap  FOV  conditions,  using  both  relationships,  conveniently  results  in  a  format  very  similar  to 
that  diagrammed  in  Figure  7a.  Of  course,  a  mixture  of  the  two  approaches  and  widely  dissimilar  system 
conditions,  might  be  combined  to  yield  significantly  different  results. 


0) 


HOR  FOV  (DEG)  = 


CRT  FORMAT  SIZE  (mm)  x  CRT  RESOLUTION  ( ip/mm) 
17.5  (mrad/DEG)  x  SENSOR  RESOLUTION  ( Ip/mrad) 


WHERE:  ASSUMED 

CRT  SPOT  SIZE  -  19.0  MICRONS  (0.019  MILLIMETERS)  OR 

26  LINE  PAIRS  PER  MILLIMETER  ( Ip/mm) 

ASSUMED 

CRT  FORMAT  SIZE  =  19.0  MILLIMETERS 
ASSUMED 

SENSOR  RESOLUTION  =  0.57  LINE  PAIRS/MILLIRADIAN  ( )p)mrad) 


8INOCULAR  FOV  OVERLAP  (DEG)  =  2x  ARCTAN  — -  -  — 1 m.? ) 

2  x  EYE  RELIEF  (mm) 


(2) 


WHERE:  NOMINAL  EYE 

SEPARATION  =  65  MILLIMETERS  (mm)  GIVEN  58-  72  (mm) 
OF  NOMINAL  ADJUSTMENT 


Having  an  approach  for  determining  the  vertical  FOV  is  also  important,  especially  since  human 
anatomical  factors  make  vertical  FOV  more  difficult  to  obtain  for  pupil-forming  HMD  systems  (Oil, 
Nominally,  the  monocular  FOV  will  have  a  4:3  aspect  ratio,  whose  vertical  FOV  will  be  determined  by  its 
horizontal  FOV  and  overlap  condition,  even  though  the  total  binocular  presentation  will  differ 
significantly  from  such  an  aspect  ratio.  However,  it  is  important  to  consider  certain  other  closely 
related  technical  factors  whose  origins  are  partially  in  the  psychovisual  domain  and  partially  in  the 
system  designer's  domain.  The  psychovisual  considerations  pertain  most  importantly  to  the  required 
size  of  the  subtended  angle  of  display  resolution  elements  to  the  eye  when  such  imagery  is  viewed  in  a 
vibrating  environment  [06).  The  basic  assumption  is  that  the  vertical  vibration  component  (normally 
having  an  orientation  approximately  perpendicular  to  the  HMD  scan  lines),  is  the  largest  and  most 
important  component  10$).  Here,  the  literature  relating  to  the  viewing  of  HMDs,  during  vibration 
suggests  that  scan  lines  should  subtend  an  angle  to  the  eye  of  2  to  4  arc  minutes.  This  statement  must 
be  viewed  with  caution,  since  observer  angular  resolution  is  dependent  on  a  number  of  interrelated 
factors,  such  as  display  luminance  and  contrast  which  are  not  always  specified  with  the  data.  In 
addition,  display  operating  conditions  normally  require  that  CRT  scan  line  width  be  adjusted  so  that 
the  scan  line  structure  is  not  visible.  However,  sufficient  dynamic  range  should  be  permitted  between 
the  minimum  and  maximum  luminance  levels,  such  that  usable  contrast  is  maintained  between  adjacent 
pixels  imaged  at  different  luminance  levels  on  adjacent  scan  lines.  To  accomplish  this  goal,  the 
display  system  designer  needs  to  establish  an  acceptable  scan  line  merge  condition  as  shown  in  Figure 
8.  The  merge  condition  selected  should  allow  a  reasonable  tradeoff  of  scan  structure  contrast  and 
vibration  induced  artifacts  which  affect  visibility  of  the  scanned  image. 


25%  MERGE  CONDITION 


40%  MERGE  CONDITION 
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SLSMC  =  SCAN  LINE  STRUCTURE  MODULATION  CONTRAST 
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PI  CORE  8 

IMPACT  OP  MERCK  POINT  SELECTION  TOR  ADJACENT  SCAR  LINES 

The  CRT  beam  width  conditions  depicted  are  12  -  14  microns  at  the  50  percent  response  point.  At 
night,  display  of  sensor  imagery  at  this  condition  is  easily  supported  by  current  miniature  CRTs. 
Given  the  previous  example  condition  of  750  visible  scan  lines,  the  distance  between  scan  lines  has 
been  adjusted  to  16  -  19  microns.  This  allows  scan  lines  to  subtend  about  3  arc  minutes  of  v  ^  .1 
angle  for  the  37.5  degree  vertical  FOV  of  the  example  HMD,  which  falls  right  between  the  2-4  arc 


minute  requirement  suggested  in  the  literature.  Ideal  gaussian  response  i9  portrayed,  although,  for 
some  miniature  CRTs,  the  tails  of  each  spot  profile  may,  at  certain  CRT  drive  conditions,  extend  out  to 
greater  distances  than  indicated  here  (08j.  When  adjusting  CRT  performance  and  HMD  POV  to  match  or 
preserve  most  of  the  initial  sensor  performance,  the  designer  usually  wants  to  insure  that  the  scan 
Line  widths  and  merge  conditions  are  adjusted  to  achieve  minimum  scan  line  structure  modulation 
contrast  (SLSMC),  when  adjacent  pixels  on  adjacent  scan  lines  are  at  peak  luminance.  Conversely, 
maximum  modulation  contrast  is  desired  between  adjacent  scan  lines,  when  every  other  scan  line  is  at 
peak  luminance  levels  and  the  adjacent  pixels  on  adjacent  scan  lines  are  at  their  minimum  luminance 
level.  These  relationships  are  shown,  for  two  separate  merge  conditions  in  Figures  8a  and  8b.  A 
reasonable  design  procedure  is  to  select  a  FOV  and  merge  condition  where,  with  adjacent  scan  lines  at 
full  luminance  levels,  the  SLSJ1C  is  kept  below  the  human  operator's  visual  demand  threshold  for  the 
modulation  contrast/resolution  conditions  obtainable  from  the  system  Isee  reference  23,  (Figure  29)1. 

It  should  be  obvious  that  the  40  percent  merge  condition  represented  by  Figure  8  cooes  closest  to 
meeting  the  stated  criteria. 

Finally,  something  must  be  said  about  attempting  to  predict  the  relationship  between  total 
anticipated  weight  for  the  HMD  optics  and  FOV.  One  predictor,  sometimes  employed  for  this  purpose,  is 
the  Lagrange  invariant  (02 ]  given  by  equation  3.  It  expresses  a  relationship  for  a  constant  level  of 


LAGRANGE  INVARIANT  =  Q  =  (EXIT  PUPIL  SIZE/2)(FIELD  ANGLE/2) 


complexity,  as  POV  is  reduced  from  some  defined  maximum,  to  obtain  an  estimate  of  the  reduction  in  the 
complexity  of  the  number  of  HMD  optical  elements  needed  in  a  specific  design.  However,  many  other 
factors  affect  this  relationship,  such  as  the  basic  optical  design,  inclusion  of  polychromatic  versus 
monochromatic  performance,  image  source  format  3ize,  and  materials,  used  in  the  design  and  fabrication 
of  an  HMD.  Thus,  any  useful  general  purpose  relationship  is  difficult  to  formulate,  although,  for  a 
specific  design  restrained  to  the  same  conditions,  equation  3  can  provide  useful  predictive  benchmarks. 

DISPLAY  OVERLAP  FOV 

Among  persons  involved  in  the  use  and  development  of  binocular  HMD  systems  there  is  much 
controversy  about  the  amount  of  display  overlap  to  use  between  the  monoculars.  Figure  5  depicts  a  40 
degree  overlap  condition  for  monoculars,  with  an  80  degree  horizontal  FOV,  or  a  50  percent  overlap 
condition.  The  approximate  theoretical  maximum  for  the  eyes  is  60  degrees.  This  condition  might  be 
obtained  with  certain  HMD  designs  if  the  total  FOV,  exit  pupil,  and  eye  relief  conditions  were 
optimized  to  support  it.  However,  helmet  slippage  on  the  head,  the  requirement  for  eyeglass 
compatibity,  and  therefore  greater  eye  relief,  etc.  make  it  difficult  to  obtain.  Experience  with  the 
Farrand  Pancake  Window  simulator  display  system  developed  for  the  Visually  Coupled  Airborne  System 
Simulator  (VCASS)  facility,  which  can  be  adjusted  for  fixed  overlap  conditions  of  20,  40,  and  60 
degrees,  has  provided  subjective  indications  that  a  display  system  with  more  overlap  provides  a  more 
pleasing  panoramic  display.  Recent,  but  not  yet  published  experiments  conducted  by  the  Army  Night 
Vision  Laboratory  with  narrower  FOV  HMDs  seem  to  suggest  similar  findings.  However,  no  definitive 
study  exists  on  this  topic.  As  a  minimum  guideline,  it  can  be  stated  that,  with  narr  w  FOV  systems 
(those  with  monoculars  having  a  horizontal  FOV  less  than  or  equal  to  40  degrees),  a  full  overlap 
condition  is  desirable  and,  for  larger  FOV  HMDs  at  least  30,  and  probably  40  degrees  of  overlap  is 
desirable . 

EXIT  PUPIL  SIZE 


The  exit  pupil  of  an  optical  system  that  has  one,  is  a  disc  to  which  all  of  the  light  from  the 
system  converges  and  from  which  it  diverges,  all  of  the  Light  available  to  the  eye.  «U«n  Cue  eye  pupil 
is  entirely  within  the  exit  pupil  all  portions  of  the  HMD  POV  may  be  viewed  instantaneously  and  at  the 
maximum  brightness  that  the  system  can  provide.  The  definitions  one  usually  reads  in  optical  texts  to 
define  exit  pupil  are  usually  for  conventional  telescopes  and  microscopes,  where  the  entering  light 
rays  are  nearly  parallel  and  close  to  the  optical  axis.  For  these  designs,  the  aperture  stop,  and 
therefore  the  exit  pupil,  is  usually  easily  defined  end  explained.  However,  the  design  constraints  for 
HMDs  require  that  a  relatively  large  object  (the  CRT  phosphor)  be  viewed  from  a  short  object  distance, 
while  still  providing  a  combination  of  large  visual  angle,  large  exit  pupil  size  and  enough  eye  relief 
to  accommodate  eye  glasses.  The  relatively  large  CRT  format,  being  close  to  the  relay  optics  lenses, 
produces  Light  rays  that  enter  the  optical  system  at  large  angles  from  the  extreme  off-axis  points  of 
the  CRT  format.  The  HMD  optics  aperture  stop  may  be  a  combination  of  stops  in  the  system  and  is  not 
easily  determined.  It  is  usually  left  to  the  optical  designer  to  define  it  and  insure  that  it  is 
obtained  for  the  desired  eye  relief  and  FOV.  However,  the  system  designer  must  supply  a  reasonable 
justification  for  the  desired  exit  pupil  size  based  upon  the  anticipated  luminance  conditions,  expected 
pupil  sizes  for  the  human  eye,  the  anticipated  quality  and  stability  of  the  helmet  system  design  into 
which  the  optics  will  be  integrated,  expected  environmental  conditions  during  operational  use,  and  the 
realities  of  the  optical  design  and  weight  penalties  associated  with  increased  exit  pupil  diameters. 

It  should  be  noted  that  pupil  size,  as  described  in  this  paper,  means  the  cross  sectional  dimension 
over  which  no  vignetting  of  the  HMD  light  occurs. 

Figure  9  9hows  a  simplified  diagram  of  the  human  eye,  taken  from  the  Military  Handbook  of  Optics 
(MlL-HDBK-141 )  with  certain  optical  constants  included,  which  can  be  used  to  obtain  a  first  order  cut 

at  calculating  the  required  exit  pupil  size.  For  this  analysis,  the  entrance  pupil  of  the  eye  has  been 

assumed  to  be  physically  approximately  3.0  millimeters  behind  the  cornea.  The  optical  distance  from 
the  cornea  to  eye  pupil  is  the  physical  distance  divided  by  the  index  of  refraction  (3.05/1.337),  of 
the  aqueous  humor,  which  is  2.25  millimeters.  This  i9  about  the  location,  where  HMD  optical  designers 

like  to  design  for  the  exit  pupil  of  the  optics  to  be  located.  The  center  of  rotation  of  the  eye  is 

approximately  13  millimeters  behind  the  cornea,  and  thus  the  rotation  center  of  the  eye  is  10  (13-3) 
millimeters  behind  the  eye  pupil,  not  at  the  pupil. 
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TOTAL  INDEX  OF 
LENS  n  « 1.42 


FIGURE  9 

OPTICAL  COHSTAJfTS  FOR  A  "STANDARD  EYE" 


Figure  10  depicts  the  essential  relationships  needed  to  calculate  eye  pupil  movement,  as  the  eye  is 
rotated  to  view  off  axis  portions  of  the  HMD  FOV.  Although  eye  pupil  diameter  can  vary  from  2-7 
millimeters,  depending  upon  d isp lay/ambient  luminance  conditions,  the  calculations  were  performed  for 
eye  pupil  sizes  of  2  and  5  millimeters,  which  is  representative  of  variations  that  might  be  observed  in 
a  rotary  wing  aircraft  HMD  application.  Using  the  dimensions  and  relationships  shown  in  Figures  9  and 
10,  equation  4  can  be  derived. 


r(sin(w  +  v)J 

EYE  PUPIL  EDGE  HEIGHT  =  h  - - 

cos  v 


(4) 


WHERE:  cos  v  =  rl(r  +Ar),  SO  (r  +Ar>  =  rlcos  v 

AND  sin  (w  +  v)  =  h/(r  +Ar) 

For  the  2  and  5  millimeter  eye  pupil  diameters,  equation  4  reduces  to 

h2  =  10.00(sin  (w  +  5.739°)] 

and 


h5  =  10.26[sin  (w  +  14.10“)] 
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PUPIL  CENTER 


r  =  RADIUS  OF  ROTATION 
PI 2  =  EYE  PUPIL  RADIUS 

V  =  ANGLE  SUBTENDED  BY  EYE  PUPIL  RADIUS 
W  =  ANGULAR  ROTATION  OF  EYE 
h  a  ABOVE  AXIS  HEIGHT  OF  EYE  PUPIL  EDGE 

X  =  DISTANCE  PUPIL  LEADING  EDGE  HAS 
RECEDED  FROM  PLANE  OF  HMD  PUPIL 


FIGURE  10 

RELATIONSHIPS  FOR  EYE  PUPIL  EDGE  POSITION  FOR  EYE  ROTATION  OF  W  DEGREES 

The  results  of  repeated  computations  using  equation  4  for  each  pupil  condition,  are  plotted  in  Figure 
11  out  to  50  degrees  off-axis,  representing  a  hypothetical  HMD  design  with  a  100  degree  horizontal 
monocular  FOV.  The  inherent  assumptions  made  here  are  that  there  is  no  field  curvature  for  the  HMD 
exit  pupil  at  the  design  eye  relief  (accomplished  either  through  highly  corrected  optics  or  optical/ 
electrical  compensation  at  the  CRT),  and  that  the  eye  is  moving  along  its  horizontal  axis.  One  must 
also  consider  the  movement  of  the  edge  of  the  eye  pupil  edge  back  from  the  plane  of  the  HMD  pupil  as 
the  eye  rotates,  because  the  HMD  pupil  becomes  smaller  at  some  rate  dictated  by  the  optical  design,  as 
one  departs  from  the  pupil  location  at  the  design  eye  relief  point  of  the  optics.  This  distance 
denoted  as  "x"  in  Figure  10  can  be  computed  in  a  fashion  simitar  to  that  for  equation  4  using  the 
relationship  shown  in  equation  5. 


DISTANCE  BEHIND  PLANE  OF  HMD  PUPIL  =  X  =  r  -  h[cot  (v  +  w)]  (5) 

The  results  obtained  applying  this  relationship  are  plotted  in  Figure  12,  out  to  an  eye  rotation  angle 
of  50  degrees,  which  again  represents  a  binocular  HMD  system  with  a  monocular  FOV  of  100  degrees.  It 
remains  for  the  optical  designer  to  specify  to  the  VPD  system  designer,  how  exit  pupil  size  decreases 
as  one  moves  away  from  its  plane  ot  maximum  cross  sectional  area. 

In  addition  to  HMD  FOV  and  eye  movement  considerations,  the  effects  of  exi^  pupil  size  on  optical 
system  weight  must  be  considered.  For  wide  FOV  display  systems,  exit  pupil  sizes  beyond  about  10 
millimeters  cause  the  weight  of  the  HMD  optical  elements  to  increase  so  substantially  that  they  quickly 
become  unacceptable  for  aircraft  helmet  systems.  One  can  achieve  a  first  cut  approximation  of  exit 
pupil  size  and  weight  impact,  on  a  particular  optical  system  design,  using  the  relationship  defined  by 
equation  6  and  illustrated  by  Figure  13  [20].  To  use  the  relationship  expressed  by  equation  6,  one  must 
insure  that  the  optical  design  is  corrected  for  the  Abbe  sine  condition  (20),  a  relationship  that 
expresses  a  condition  that  applies  to  optical  systems  free  of  certain  aberrations  for  off-axis  points, 
particularly  primary  coma  (21,24 1.  Most  high  quality  HMD  designs  are  corrected  for  these  aberrations. 


DISTANCE  OF  PUPIL  LEADING  EDGE  o  OFF-AXIS  DISTANCE  OF  PUPIL 

BEHIND  HMD  EXIT  PUPIL  (MILLIMETERS)  ?  EDGE  IN  MILLIMETERS 


EYE  ROTATION  IN  DEGREES 


FIGURE  11 


XIS  DISTANCE  OP  EYE  PUPIL  LEADING  EDGE 


VERSOS  EYE  ROTATION  ANGLE 


EYE  ROTATION  ANGLE  (DEGREES) 


PIG0RE  12 

BYB  PUPIL  LEADING  EDGE  DISTANCE  BEHIND  HMD  PLANE  OP  MAX  PUPIL  DIAMETER  VERSOS 
EYE  ROTATION  ANGLE 
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0=StN~1(h1/EFL) 


(6) 


WHERE:  h,  =  HALF-HEIGHT  OF  EXIT  PUPIL  OF  HMD  OPTICS 

6  =  SEMI-CONVERGENCE  ANGLE  FOR  HMD  OPTICS  INPUT  FROM 

IMAGE  SOjRCl.  .nPUT  <CRT) 

EFL  a  EFFECTIVE  FOCAL  LENGTH  OF  HMD  OPTICAL  SYSTEM 


FIGURE  13 

DEPICT ION /EXPRESSION  OF  RELATIONSHIP  FOR  DETERMINING  EXIT  PUPIL  SIZE 

For  an  F-Theta  mapped  system,  such  as  the  Farrand  Pancake  Window  HMD  and,  indeed,  most  binocular  HMD 
designs,  the  effective  focal  length  (EFL)  for  the  whole  system  can  be  computed  from  equation  7, 

(CRT  FORMAT  SIZE  (HOR)l  (1809) 

EFL  - - x - -  /7\ 

(HMD  HOR  FOV  (DEG)j  7T 

Results,  originally  formally  presented  in  reference  (20),  for  both  the  growth  in  semi-convergence  angle 
and  relay  optics  weight,  are  again  presented  here,  by  Figures  14  and  15,  for  completeness  and  to  stress 
the  difficulty  of  obtaining  large  exit  pupils,  for  the  range  of  system  focal  lengths  normally 
obtainable  for  HMDs  (see  Table  2). 


□  OLD  PANCAKE  WINDOW  SYSTEM 

O  ORIGINAL  DESIGN  FOR  NEW  PANCAKE  WINDOW  SYSTEM 
A  FABRICATED  DESIGN  FOR  NEW  PANCAKE  WINDOW 


FIGURE  14 

PLOT  OF  PUPIL  DIAMETER  VERSUS  SEMI -CONVERGENCE  ANGLE  (PANCAKR  WINDOW  HMD) 
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EXIT  PUPIL  DIAMETER  (mm) 


FIGURE  15 

PLOT  OF  RELAY  OPTICS  WEIGHT  VERSUS  EXIT  FUPIL  DIAMETER  (PANCAKE  WINDOW  HMD) 

The  remaining  major  factors  affecting  exit  pupil  size  are  the  environmental  operating  conditions  and 
the  design  of  the  headgear.  Clearly,  aircraft  operating  in  a  high  "G"  environment  may  need  a  larger  exit 
pupil  to  prevent  display  vignetting  due  to  helmet  slippage  on  the  head.  Thij  may  be  largely  overcome  by 
designing  a  system  with  a  smaller  more  compact  FOV  with  less  eye  relief,  which  in  turn  prevents  the 
creation  of  significant  inertial  moments  that  would  accentuate  display  movement  from  external  forces. 
Also,  as  will  be  presented,  the  design  of  an  integrated  headgear  which  anticipates  and  attempts  to 
prevent  large  helmet  movements  can  also  reduce  the  need  for  very  large  exit  pupil  sizes. 

Hence,  a  generalized  worst  case  condition  might  be  hypothesized  based  upon,  (1)  feasible  operational 
designs,  which  will  probably  not  achieve  a  monocular  FOV  greater  than  60  degrees  horizontal  by  45  degrees 
vertical  (resulting  in  maximum  off-axis  angles  of  +/-  30  and  22.5  degrees  respectively,  and  therefore,  a 
radial  angle  of  37.5  degrees),  and  (2)  the  sparse  human  factors  data  related  specifically  to  HMDs,  which 
suggests  that  the  human  operator  does  not  usually  move  his  eye  off-axi9  when  viewing  the  HMD  by  more 
than  +  /-  20  degrees  before  moving  his  head.  An  important  qualifier  here,  as  mentioned  in  [201,  are 
binocular  display  systems  which  rotate  the  HMD  optical  axis  to  achieve  greater  horizontal  FOV,  using 
partial  overlap  of  the  monoculars.  Figure  16  depicts  the  exit  pupil  cross  section,  as  it  would  appear 
located  normal  to  the  eye  with  no  tilt  of  the  binocular  optical  axes  (which  would  be  employed  for  a 
system  having  partial  overlap  of  its  monoculars).  Also  portrayed  are  important  HMD  system  physical 
relationships.  The  relationships  portrayed  by  Figure  16  should  be  considered  a  worst  case  condition, 
because  the  exit,  pupil  size  is  based  upon  a  full  field  condition.  If  the  portion  of  the  field  lor 
object  size),  which  must  be  visible  simultaneously  is  reduced,  then  the  diamond  shape  area,  over  which 
the  reduced  field  can  be  simultaneously  viewed,  will  become  proportional ly  much  larger.  As  Figure  16 
shows,  the  only  honest  specification  for  eye  relief/exit  pupil  size,  is  one  that  results  in  the  proper 
positioning  of  the  maximum  cross-sec t iona  1  pupil  area  on  the  eye.  Other  positioning  points  result  in  a 
reduced  effective  exit  pupil  size  for  no  vignetting.  If  the  orientation  of  the  HMD  exit  pupil  is 
normal  to  the  cornea,  then  symmetric  movement  of  the  eye  is  possible  with  similar  vignetting  or  lack 
thereof.  However,  if  as  noted  in  [20],  Che  monocular  HMD  optical  axes  are  turned  out  to  obtain  a 
partial  overlap  condition,  then  the  movement  to  one  side  of  the  exit  pupil  (normally  the  direction  for 
divergence  of  the  eyes),  is  restrained  for  the  nominal  interpupi 1 lary  distance  (IPD)  This  must  be 
compensated  for  by  adjusting  the  optics  to  a  somewhat  wider-than-norma  1  IPD  (usually  by  3-5 
millimeter.. ) . 

Given  the  preceding  considerations,  a  worst  case  condition  can  be  picked  tor  the  5  millimeter  pupil 
size  at  the  20  degree  otf-axis  position,  which  results  in  a  nominal  indicated  translation  of  +  or  -  6 
millimeters.  If  one  then  addo  to  this  ♦  or  -  3  millimeters  of  translation  due  to  helmet  movement  (a 
reasonable  amount  for  a  well  designed  integrated  helmet  system,  used  for  a  rotary  wing  aircraft  or 
simulator  application),  one  arrives  at  a  nominal  exit  pupil  size  of  about  18  millimeters.  In  practice, 
at  least  for  the  breadboarded  designs  listed  in  Table  2,  an  exit  pupil  size  of  14  -  17  millimeters  has 
been  found  to  be  sufficient.  For  applications  where  weight  is  extremely  important,  a  pupil  size  toward 
the  low  end  of  the  range  would  probably  be  selected. 
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EYR  RELIEF /CLEARANCE 

As  depicted  by  Figure  16,  the  distance  used  to  specify  eye  relief,  should  be  measured  from  the 
viewing  center  of  the  final  optical  surface  closest  to  the  eye,  to  the  optimal  position  for  the  largest 
cross-sectional  area  of  the  optics'  exit  pupil  with  respect  to  the  eye.  Table  2  lists  a  range  of 
different  distances  for  the  five  optical  breadboards,  which  were  developed  as  part  of  the  VPD  effort. 
Generally,  designs  providing  35  millimeters  or  more  of  eye  relief,  present  no  major  operational  problems, 
and  allow  most  eyeglasses  to  be  accommodated.  However,  it  is  prudent  to  keep  eye  relief  as  small  as 
possible,  because  for  a  given  FOV,  a9  eye  relief  increases,  so  does  the  size  and  weight  of  the  optics, 
in  a  manner  proportional  to  the  design  approach  employed.  Another  similar  f igure-of-merit  rFOM),  used 
to  describe  display  system  positioning  around  the  eye,  is  eye  clearance.  The  gcr.'rally  accepted 
meaning  of  this  term  is  that  it  defines  the  point  of  closest  approach  of  the  HMD  combiner  and/or 
beamsplitter  assembly  to  any  part  of  the  eye.  A  curved/tilted  combiner  assembly  can  often  yield  much 
smaller  eye  clearance  distances  than  those  given  for  eye  relief.  Experience  with  the  breadboard 
designs  listed  in  Table  2  shows  that  eye  clearance  distances  of  less  than  20  millimeters  present  major 
difficulties,  particularly  when  its  use  in  an.  jpetational  aircraft  environment  is  contemplated. 

COLLIMATION 

For  the  VPD  application,  it  is  usually  required  that  the  display  imagery,  which  is  overlayed  on  the 
ambient  or  outside-of-cockpit-scene  be  at  optical  infinity  (col limated).  This  permits  minimal  or  no 
refocusing  time  between  the  HMD  display  and  the  outside  world  scene.  It  is  also  important  because  the 
helmet  lighting  system  (as  shown  in  Figure  1)  uses  the  VPD  HMD  to  image  its  sighting  reticle.  The  reticle 
is  electronically  aligned  with  the  helmet  sensor  during  the  system  boresighting  process.  If  the  reticle 
image  is  not  collimated,  then  there  will  be  parallax  error  between  the  helmet  sighting  system  and 
external  scene  for  targets  being  designated  by  the  display  sighting  reticle.  Collimation  can  be  checked 
by  placing  a  powerful  (20x  magnification  or  higher)  telescope  focused  for  infinity  in  the  HMD  exit  pupil, 
and  checking  for  sharpness  of  the  display  imagery.  If  the  imagery  is  in  focus,  one  can  usually  be  sure, 
that  the  display  is  collimated  to  within  a  small  fraction  of  a  diopter,  which  is  normally  sufficient. 
Display  designs  which  have  their  combiner  surfaces  separate  from  the  helmet  lens  or  visor,  usually 
maintain  collimation  much  better  than  designs  that  use  the  helmet  visor  as  the  last  display  imaging 
surface.  This  is  because  visors  are  normally  susceptible  to  deformations  during  helmet  flexure,  etc., 
which  alter  the  focus  of  the  display  system.  Attempts  were  made,  early  in  the  VPD  HMD  program,  to 
develop  an  alternate  focus  or  image  location  for  the  display  format,  so  that  the  display  imagery  might 
also  be  optically  located  at  the  same  distance  as  the  cockpit  instrumentation  when  the  pilot  was 
attempting  to  interact  with  internal  cockpit  instruments.  The  two  conditions  would  be  monitored  by  the 
helmet  position/orientation  sensing  system  and  the  image  location  would  be  rapidly  shifted  automatically. 
However,  no  compact,  lightweight  adjustment  mechanism  could  be  found  and  attempts  to  achieve  this 
function  were  abandoned. 

MAPPING/DISTONTION 

For  binocular  HMD  designs,  particularly  designs  where  the  monocular  fields  are  partially  overlapped, 
F-theta  mapping,  which  provides  constant  angular  resolution  over  the  display  FOV,  is  often  the  best 
choice  for  the  mapping  of  a  display  system's  angular  resolution  1 03 , 20 J .  However,  F-tangent  theta 
mapping,  where  the  tangent  of  the  field  angle  is  proportional  to  the  image  source  chordal  height, 
represents  the  no-distortion  mapping  condition.  F-theta  mapping,  where  the  image  field  angle  is 
proportional  to  the  image  source  chordal  height,  yields  pincushion  distortion.  Therefore,  some  form  of 
compensating  distortion,  nominally  representing  barrel  distortion,  must  be  introduced  into  the  CRT 
imagery.  The  distorted  CRT  imagery  corrects  or  linearizes  the  virtual  image  of  the  CRT  when  viewed 
through  the  HMD  optica.  Figure  17  depicts,  in  simple  form,  the  mapping  relat ionshipa  between  the  eye  and 
CRT,  and  shows  the  derivation  of  the  relationship  for  the  required  correction.  Alternate  explanations  of 
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this  problem  may  be  found  in  101,02,20,22).  The  CRT  drive  electronics'  deflection  circuitry  must  be 
designed  to  support  such  correction.  The  VPD  system  integrator  must  be  sure  that  the  required 
correction,  and,  therefore,  expansion  or  compression  of  CRT  pixel  spacing  at  different  portions  of  the 
CRT  faceplate,  can  be  supported  i»y  l\\&  inherent  performance  of  the  CRT  and  its  drive  electronics.  The 
arctangent  function  ia  difficult  to  implement  with  analog  display  electronics.  Therefore,  CRT  deflection 
geometry  correction  is  usually  implemented  by  a  truncated  polynomial  approximation,  using  terras  out  to 
third  order,  as  discussed  later  in  this  paper. 

Residual  field  curvature  may  also  be  left  in  the  optical  design  because  its  complete  elimination 
would  result  in  a  larger  number  of  optical  elements  and,  correspondingly,  a  heavier  design.  This 
residual  field  curvature  is  usually  reduced  to  negligible  proportions  by  adding  a  corrective  curvature  to 
the  CRT  faceplate,  resulting  in  some  additional  complexity  for  the  CRT,  but  adding  almost  no  additional 
helmet  system  weight.  The  shape  of  this  curvature  fay  be  either  convex  or  concave,  depending  upon  the 
requirements  of  the  optical  design. 

LIGHT  MANAGEMENT  (TRAHSHISSION  EFFICIENCY /MODULATION  CONTRAST) 

As  mentioned  much  earlier  in  this  paper,  the  contrast  achieved  for  the  displayed  imagery  and  the 
amount  of  see-through  permitted  to  the  ambient  scene  is  probably  the  most  important  design  relationship 
for  most  HMD  applications.  This  is  especially  true  for  the  VPD,  where  the  head  mounted  display  is 
supposed  to  be  the  pilot's  primary  display  device,  and  is  critical  for  maintaining  the  required  level  of 
"situation  awareness."  For  the  systems  listed  in  Table  2,  the  key  to  light  management  and  the 
establishment  of  the  proper  transmission  efficiencies  for  image  source  and  ambient  light  is  the  design  of 
the  display  combiner  and/or  beamsplitter  elements. 

The  two  roost  common  configurations  for  the  HMD  corabiner/bearasplitter  (C/B)  components,  and  their 
relationship  with  respect  to  the  image  source/relay  len9  input  and  observer's  eye  position,  are  shown  in 
Figures  18a  and  18b.  The  coatings  used  on  each  of  the  C/B  surfaces  are  optimized  for  the  intended  range 
of  applications  including  day/night  viewing  with  symbology  and/or  imagery.  They  must  also  accommodate 
the  performance  of  the  image  source,  and  its  capabilities  to  adjust  for  the  relative  transmission 
efficiencies,  for  light  arriving  at  the  eye  from  the  display  image  source  or  the  outside  scene.  The  most 
often  used  f igure-of-meri t  (FOM)  describing  the  quality  of  C/B  light  management  (derived  in  reference 
[22)),  is  again  listed  here  in  equation  8  for  completeness  and  the  convenience  of  the  reader  who  might 
want  to  compute  hypothetical  cases  for  the  systems  listed  in  Table  2.  Equation  8  specifies  the  maximum 
amount  of  HMD  contrast  that  can  be  achieved  for  a  given  viewing  condition  and  the  coatings  design  used  in 
a  particular  HMD  design.  The  value  obtained  in  Equation  8,  can  oe  convoluted  with  (multiplied  by)  the 
system  MTF  computed  for  the  CRT -drive  electronics  and  optics,  to  obtain  an  estimate  of  total  system  MTF 

[22.23) .  The  derivation  of  system  MTF  re lat ionsh ips,  fjr  the  CRT/optics  combination,  has  been  explained 
in  reference  22,  and  will  not  be  repeated  here.  Values  for  Cd  of  0.2  to  0.3  are  generally  accepted  as 
providing  enough  contrast  to  view  line  graphics  symbology.  Values  for  Cd  of  0.8  to  0.9  are  felt  to 
provide  enough  contrast,  to  portray  approximately  8  discernible  linear  y/~2  gray  shades  of  imagery 

[22.23] . 

Insertion  of  a  few  values  into  equation  8,  and  a  review  of  reference  22,  should  be  sufficient  to 
emphasize  the  importance  of  the  type  and  quality  of  the  C/B  coatings.  Systems  utilizing  a  combiner 
system  like  that  shown  in  18a,  such  as  systems  4  and  5  in  Table  2,  are,  with  current  technology,  much 
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WHERE:  Cd  =  CONTRAST  (MAXIMUM)  OF  HMD  IMAGE 

Li  =  HMD  IMAGE  SOURCE  LUMINANCE  PRIOR  TO  COMBINER 
Lb  =  BACKGROUND  SCENE  LUMINANCE 

Rc  =  COMBINER  REFLECTANCE  COEFFICIENT  (*)  (FOR  VPD  HMD 
APPLICATIONS  NORMALLY  OPTIMIZED  FOR  P53  PHOSPHOR 
GREEN  EMISSION  PEAK) 

Tc  =  COMBINER  TRANSMITTANCE  COEFFICIENT  (•)  (TOTAL 
SCOTOPIC  TRANSMISSION) 

<*)  FOR  WAVELENGTH  SENSITIVE  COATINGS.  INTEGRATION  OVER 
WAVELENGTH  IS  ASSUMED 

mure  efficient  light  management  systems,  since  they  do  not  suffer  the  approximate  75'4  loss  of  luminance 
at  the  beamsplitter’s  metallic  coating  surface,  as  shown  in  18b,  and  exemplified  by  systems  2  and  3  in 
Table  2.  However,  for  the  same  POV,  systems  like  4  and  3,  which  use  primarily  refractive  optics  to 
convey  the  CRT  image  to  the  eye,  are  usually  much  heavier  than  catadioptric  designs,  like  systems  2  and 
1.  As  described  in  (141,  narrowband  high  efficiency  multilayer  dielectric  coatings  have  been  developed, 
which  are  tailored  to  reflect  the  primary  spectral  band  of  CRT  phosphors,  such  as  P4 3  and  P53.  These 
coatings  allow  most  of  the  external  ambient  light  to  pass  with  minimal  attenuation,  except  in  the  band 
set  aside  for  reflection  of  Che  CRT  image  source  light.  A  drawback  to  these  coatings  is  that  they 
require  combiner  designs  where  the  incident  angle  of  the  image  source  light  is  almost  constant  across  the 
entire  FOV ,  and  they  attenuate  a  wider  (f>0  to  80  nanometers)  bandwidth  than  desired  of  the  ambient  visual 
spectrum  !l4j.  A  relatively  new  type  of  ref lec t i ve/ t rans m i ss i ve  layer,  dubbed  a  holographic  simple 
mirror,  has  recently  become  available,  and  attempts  are  being  made  to  incorporate  this  technology  into 
HMD  systems.  Holographic  simple  mirrors  are  made  from  volume-phase  reflection  type  holograms  embracing 
photochemical,  interference  and  refractive  phenomena,  and  diffract  light  as  conventional  mirrors  reflect 
light  1  OS  1 .  They  s^pm  to  hold  promise  for  moderating  the  angle-sensitivitv  and  bandwidth  problems 
associated  with  multi-layer  dielectric  coatings  |09).  Multilayer  dielectric  coatings,  with  wide 
reflective  bandwidths  "notch  out"  a  significant  portion  of  the  ambient  spectrum,  often  adding  a  slight 
pink  tinge  to  the  ambient  scene.  In  contrast,  the  holographic  mirror  technology  offers  the  possibility 
of  obtaining  very  narrow  reflective  bands  of  10  to  20  nanometers  or  less,  which  can  be  tailored  to  the 
primary  emission  peak  of  the  phosphor,  thus  allowing  transmission  of  more  of  the  outside  ambient  light. 
Ant  i  ref  leCt  i  on  (AR)  coatings  can  be  formulated  from  a  number  of  materials  [14,  15),  and  must  be  applied 
to  prevent  unwanted  reflections  that  cause  second  surface  ghosting,  as  explained  in  (221.  Problems  with 
secondary  image  ghosts  may  be  further  reduced  by  striking  an  appropriate  balance  for  the  attenuation  of 
ambient  light,  from  the  outside  scene,  using  both  surface  coatings  and  continuous  absorptive  media 
throughout  the  combiner  material. 

An  additional  issue,  not  often  discussed  for  HMD  design  and  difficult  to  assess,  is  the  optical 
system  MTP  and  the  relevancy  of  data  supplied  by  the  optics’  manufacturers  concerning  MTF.  A  relation¬ 
ship,  that  can  be  used  to  compute  a  close  approximation  to  tested  optical  system  MTU‘  performance,  based 
upon  preliminary  optical  design  data,  is  given  in  equation  9.  Using  system  2,  Table  2  as  an  example, 
the  system  f'l  would  be  lb.°/2l,  which  equals  0.8.  However,  equation  9  must  he  modified  to  reflect  the 
system  MTF  (  that  of  the  measurement  system/HMD  optics),  or  the  "relative  aperture"  of  the  system.  A 
reasonable  setting  for  the  measurement  system  is  an  aperture  of  *mm,  which  reflects  a  midpoint  for  the 
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eye's  range  of  pupil  sizes.  The  f#  of  the  measurement  system  is  then  16.9/4,  which  equals  4.225. 

Using  the  wavelength  for  peak  green  light  for  P53  phosphor  of  545  nanometers  (0. 000545mm),  equation  9 
gives  a  diffraction  limited  resolution  of  434  lp/mm.  Using  the  normalized  values  for  MTF,  for  an  ideal 
aberration  free  system  (21 1,  as  a  function  of  percent  of  cutoff,  given  in  Table  3,  one  may  plot  the  the 
ideal  theoretical  MTF  curves  for  the  HMD/test  instrumentation  system,  (assuming  it  is  well  corrected 
and  free  of  significant  aberrations),  as  shown  in  Figure  19. 
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The  bracketed  area  of  Figure  19  highlights  the  region  of  interest,  where  the  nominal  performance  of 
current  CRT  image  sources  fall.  Current  miniature  CRTs  resolve  less  than  40  lp/mm.  Similar  plots  can 
be  made  for  a  particular  HMD  design,  and  used  to  check  both  the  results  of  optics  acceptance  testing 
and  combined  with  equation  8,  to  hypothesize  more  exactly  expected  HMD  system  performance.  It  must  be 
stressed  that  the  curve  shown  depicts  highly  ideal  on-axis  conditions.  Measured  values  for  the 
bracketed  area  of  spatial  frequencies,  that  depart  markedly  (i.e.,  down  to  about  50  percent  response) 
from  the  representative  curve  shown  in  Figure  19,  do  not  necessarily  indicate  an  inferior  optical 
design.  However,  the  aircraft  sensor  system  designer  usually  insists  on  reserving  about  60  percent  of 
the  total  sensor/HMD  system  MTF  for  the  sensor  system.  The  implication  of  this  requirement  for  the 
optical  design,  is  that  values  close  to  those  shown  in  Figure  19  must  be  obtained,  to  allow  total 
system  MTF  requirements  to  be  met.  In  practice,  it  has  been  possible  to  achieve  such  values  for 
certain  HMD  optical  designs. 

COLOR 

The  incorporation  of  a  color-corrected  design  into  the  VPD  HMD  optics  is  certainly  a  desirable 
feature  because  color  image  source  inputs  can  add  significant  additional  information  and  cues.  Color 
imagery  may  also  aid  "situation  awareness,"  especially  when  the  HMD  sensor  scene  is  the  primary  input 
from  the  outside  world.  More  importantly,  CRTs  using  narrowband  phosphors,  which  may  have  significant 
spectral  emission  peaks  at  other  wavelengths  in  the  visual  spectrum,  need  not  be  filtered,  and 
therefore,  all  of  their  light  can  be  used  to  maximize  luminance  contrast  at  the  display  combiner. 

However,  color-corrected  optics  usually  result  in  a  system  with  many  more  optical  elements,  increasing 
helmet  weight  significantly.  As  Table  2,  shows,  only  one  of  the  five  VPD  HMD  breadboards  is  a 
polychromatic  design  because  of  the  extreme  weight  penalties,  that  are  associated  with  full  color- 
corrected  designs.  An  even  more  important  factor  is  that  the  combiner,  must  now  incorporate  lower 
efficiency  broad  spectrum  reflective  coatings  for  tl.e  HMD  image  source  light,  and,  consequently,  the 
advantage  of  using  a  narrow  band  reflective/broadband  transmissive  coating  scheme,  to  maximize 
transmission  of  both  the  image  source  and  ambient  light,  is  lost.  Luminance  contrast  ratios  between 
the  HMD  imagery  and  the  ambient  scene  may  also  be  reduced. 

Monochromatic  HMD  designs  require  narrowband  phosphors  to  avoid  lateral  and  axial  color.  Lateral 
color  artifacts  produce  a  blurred  second  image  of  a  different  color,  due  to  differences  in  image 
magnification.  The  result  is  different  image  sizes  for  different  wavelengths  of  light  [21 J.  Axial  color 
artifacts  show  up  as  longitudinal  chromatic  aberrations,  due  to  light  rays  of  differing  spectral 
wavelength,  undergoing  different  amounts  of  refraction  [21  J.  These  color  aberrations  are  often  most 
noticeable  at  the  edge  of  the  HMD  exit  pupil.  Tolerances  for  axial  and  lateral  color  that  seem  to  have 
worked  well  for  the  VPD  systems  are  provided  in  the  section  concerning  miscellaneous  optical 
specifications  in  Table  4. 

The  phosphor  of  choice  for  the  VPD  HMD  designs  has  been  P53,  because  of  its  extremely  rugged  thermal 
and  emission  life  characteristics  and  luminous  efficiency.  The  yellow-green  primary  emission  spectrum  of 
P53  provides  good  color  contrast  against  colors  found  in  land/9ea  terrain,  anJ  is  close  to  wavelengths, 
where  the  eye's  spectral  response  is  at  a  maximum.  P53  though,  ha9  significant  red  and  blue  emission 
peaks  which  must  be  removed  for  proper  operation  with  the  VPD  HMD  monochromatic  designs.  For  systems 
that  require  glass  CRT  faceplates,  attempts  were  made  to  utilize  multilayer  coatings  developed  by  Optical 
Coating  Labs  Inc.  (OCLI)  between  the  CRT  phosphor  and  faceplate  that  would  both  filter  out  the  red  or 
blue  peaks,  and  allow  more  of  the  green  light  to  exit  the  faceplate  115).  These  antihalation  coatings, 
when  used  with  a  compatible  antireflection  coating  on  the  outside  surface  of  the  faceplate,  also  enhance 
the  display  contrast  obtained  from  glass  faceplates  CRTs.  Preliminary  experience  with  these  coatings 
shows  that  improved  contrast  and  luminance  are  obtained,  but  some  residual  and  noticeable  red  and  blue 
light  i9  still  transmitted.  This  has  required  the  inclusion  of  a  green  transmissive  filter,  to 
completely  suppress  remaining  red  or  blue  emissions.  For  VPD  HMD  monochromatic  designs  which  require  a 
shaped  fiber  optic  faceplate,  the  green  transmissive  filter  is  also  needed.  Use  of  the  OCLl  coatings 
with  fiber  optic  faceplate  systems  has  not  been  possible  to  date,  because  their  physical  properties  do 
not  provide  necessary  tolerance  to  the  high  temperatures  to  which  the  coatings/faceplate  are  subjected 
during  the  coating  deposition  process. 

MISCELLANEOUS  VPD  OPTICAL  SYSTEM  SPECIFICATIONS 

Remaining  miscellaneous  VPD  HMD  system  parameters  and  suggested  toleiances  that  have  produced 
satisfactory  results  for  the  breadboard  systems  listed  in  Table  2  are  listed  in  Table  4.  Some 
additional  explanation  should  be  given  here  concerning  Che  requirement  for  IPD  adjustment  and  alignment 
(allowed  divergence,  dipvergence,  etc.).  The  calculations  for  maximum  exit  pupil  size,  covered 
earlier,  do  not  include  provision  for  centering  the  HMD  exit  pupils  for  an  individual's  eye  center-to- 
center  distances.  Interpupillary  distances  vary  from  between  55  to  74  millimeters  for  the  1st  to  99th 
percentile  for  adult  humans,  so  some  reasonable  allowance  must  be  made  for  this  variation  to  prevent 
vignetting,  while  minimizing  the  range  of  adjustment  allowance,  which  can  have  a  significant  impact  on 
the  helmet/display  optics  interface  and  system  weight.  The  variation  given  .n  Table  4,  specifies  a 
range  that  appears  to  have  produced  satisfactory  results,  but  should  not  be  considered  definitive. 

Alignment  tolerances  are  also  felt  to  be  critical,  because,  while  human  accommodat ive  (focus)  and 
convergence  powers  are  substantial,  failure  to  insure  proper  alignment,  may  result  in  fatigue  and 
psychovisual  problems  of  unsuspected  origin  during  extended  operational  use  of  a  misaligned  system. 
Divergence,  which  is  an  unnatural  and  difficult  condition  for  the  eyes,  should  be  set  to  zero.  This  is 
normally  easily  accomplished,  because  the  binocular  HMD  is  adjusted  to  error  toward  some  convergence, 
during  mechanic al /e lectronic  alignment.  However,  convergence  can  produce  false  stereoscopic  cues  between 
the  monoculars  and,  therefore,  should  also  be  minimized.  A  reasonable  convergence  setting  should  produce 
an  accommodation  error  of  less  than  a  tenth  diopter.  This  setting  can  be  computed  using  the 
relationship,  that  convergence  distance  in  millimeters,  equals  the  interpupillary  distance  (IPD)  in 
millimeters  divided  by  the  convergence  error  in  radians.  For  a  nominal  IPD  of  63  millimeters,  and  12  arc 
minutes  of  convergence,  as  given  in  Table  4,  the  convergence  distance  is  10,938  millimeters  or  10.9 
meters.  Since  diopters  equal  the  reciprocal  uf  distance  in  meters,  the  convergence  error  represents 
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leaa  than  a  tenth  diopter,  which  is  an  appreciably  smaller  error  than  that  in  prescription  spectacles. 
It  remains  for  operational  testing  of  the  VPD  binocular  HMD  to  verify  that  this  criteria  provides 
satisfactory  results,  or  should  be  modified.  Dipvergence  should  also  be  made  as  close  to  zero  as 
possible  to  prevent  mismatch  between  symbology  or  scan  lines.  Normally,  a  dimensional  tolerance  of  one 
scan  line  width  (about  3  arc  minutes)  is  desired,  but  cannot  be  provided  by  the  optics/headgear 
adjustments  alone,  so  proper  electronic  alignment  patterns  and  adjustment  capability,  must  be 
incorporated  into  the  CRT  display  electronics. 


TABLE  4 

SUMMARY  OF  MISCELLANEOUS  REQUIREMENTS  FOR  VPD  HMD  OPTICS 


ABERRATIONAL  DISTORTION 

CENTER  .  UP  TO  0.2  PERCENT 

MAX  OFF-AXIS .  UP  TO  0.5  PERCENT 

COLOR  (MONOCHROMATIC  APPROXIMATION) .  535-555  NANOMETERS 

AXIAL  COLOR .  LESS  THAN  1.5  ARC  MINUTES 

LATERAL  COLOR .  LESS  THAN  3.0  ARC  MINUTES 

MAGNIFICATION  IMBALANCE  FOR 

BINOCULAR  DISPLAY  CONFIGURATIONS  .  LESS  THAN  1  PERCENT 

SEE-THRU  DISTORTION .  LESS  THAN  2  PERCENT 

MAXIMUM  CONVERGENCE/DIVERGENCE .  12/0  MINUTES  OF  ARC 

MAXIMUM  DIPVERGENCE .  6  MINUTES  OF  ARC 

PERIPHERAL  VISION  OCCLUSION .  MINIMIZED 

IMAGE-TO-GHOST  RATIO  .  120/1 

MAXIMUM  ACCEPTABLE  LIGHT  IMBALANCE .  0.5  PERCENT  (OPTICS  ONLY) 

BINOCULAR  IPD  ADJUSTMENT .  58  TO  72  MILLIMETERS 


VPD  HMD  IKAGH  SOUBCg 

As  explained  earlier  during  the  discussion  concerning  VPD  design  alternatives  (see  Figure  3),  the  HMD 
with  head  mounted  image  source  was  selected  as  the  only  viable  alternative,  given  the  current  state  of 
technology.  Great  strides  are  being  made  with  solid  state  image  sources,  and  laser  generated  displays 
loom  on  the  horizon  as  a  potentially  powerful  alternative.  Even  so,  significant  advancements  have  also 
been  made  in  miniature  CRT  technology,  which  still  makes  them  the  current  best  choice  for  a  VPD  HMD 
application.  Besides  their  basic  light  conversion  efficiency  and  resolution,  there  «*re  other  reasons  for 
selecting  the  CRT.  One  is  that  CRT  image  source  technology  does  not  impose  a  strict  allocation  of 
display  elements  across  the  display  format  whose  relative  size  and  activation  characteristics  are 
fixed.  Therefore,  horizontal/vertical  smoothing  l antialiasing)  techniques,  may  be  applied  to  smooth 
the  appearance  of  straight  edges  (particularly  from  man-made  objects),  that  cross  tne  scanning  format 
diagonally,  producing  staircasing  effects  and  visual  artifacts.  Generally,  a  solid  state  display 
requires  several  times  the  inherent  resolution  of  a  CRT  to  match  the  apparent  smoothness  of  the  CRT's 
imagery.  Since  current  miniature  CRTs  can  provide  in  excess  of  1  million  resolution  elements,  solid 
state  displays  for  HMDs  have  significant  performance  barriers  to  overcome.  In  small  sizes  they 
currently  have  much  lower  resolution  than  CRTs.  In  addition,  a  CRT  image  source  may  present  randomly- 
written  vector  graphic  information,  providing  only  smooth  line  segments  at  any  orientation  on  Che 
display.  This  symbology  may  be  updated  at  refresh  rates  much  higher  than  normal  video  field  rates  to 
achieve  much  brighter  peak  line  luminance  levels  for  daylight  viewing.  This  is  possible  by  taking 
advantage  of  optimum  charge  pumping  techniques,  which  some  of  the  new  rare  earth  phosphors  permit  [04]. 
For  these  reasons,  only  the  CRT  image  source  is  considered. 

Figure  20  depicts  the  direct  impact  on  miniature  CRTs  of  certain  image  source  parameters  due  to  the 
requirements  for  good  display  contrast  and  resolution  on  the  HMD,  especially  when  employing  a  see- 
through  combiner.  CRT  Line  widths  must  be  kept  small,  and  active  area  format  sizes  made  as  large  as 
possible,  given  an  overall  maximum  allowed  CRT  diameter  of  about  one  inch.  Line  rates,  refresh  rates 
and,  as  possible,  anode  potentials  must  be  increased  to  balance  resolution  and  light  conversion 
eff icienciea.  At  the  same  time,  faceplate  contrast  must  be  preserved  so  that  individual  adjacent 
resolution  elements  remain  distinct  and  discernible  to  the  eye.  This  requires  a  higl  efficiency,  fine 
grain  size  phosphor  formulated  for  optimum  light  emission/ transparency  and  thermal  conductivity, 
coupled  with  a  faceplate  system,  such  as  those  using  fiber  optics,  which  offer  improved  contrast. 

To  bring  about  substantial  performance  gains  in  the  CRT  during  the  VPD  HMD  effort,  an  attempt  was 
made  through  a  number  of  studies  [04,17,18],  to  identify  major  problem  areas,  where  improvement  had  to 
be  made.  These  are  listed  in  Table  5.  Improvements  in  the  problem  areas  listed  in  Table  3,  had  to  be 
made  in  the  context  of  the  design  limitations  imposed,  by  the  electromagnetic  def lection(EMD)/ 
electrostatic  focus  lens  (E$FL)  system,  which  has  been  found  to  be  most  suitable  for  miniature  CRT 
applications.  A  representative  CRT  design,  showing  the  major  relationships  between  internal 
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FIGURE  20 

DISPLAY  REQUIREMENT  IMPACT  ON  IMAGE  SOURCE  PERFORMANCE 


TABLE  5 

MAJOR  PERFORMANCE  LIMITING  PROBLEM  AREAS  FOR  MINIATURE  CRTS 


CRT  FACEPLATE  SYSTEM 

ELECTRON  OPTICS 

OTHER  PROBLEMS 

MAINTAIN  HIGH  LUMINOUS 

ELECTRON  OPTICS  CAPABLE 

ACCELERATION  VOLTAGE 

EFFICIENCY  DURING  ALL 

OF  FOCUSING  SMALL  BEAM 

CRT  DRIVE  CONDITIONS 

DIAMETER  AT  HIGH  BEAM 
CURRENTS 

CRT’S  PHYSICAL  SIZE 

MAGNIFICATION 

THERMAL  LIMITATIONS 

MINIMIZE  PHOSPHOR’S 
CONTRIBUTION  TO  BEAM 
SPREADING/UNE  WIDTH 

SPACE  CHARGE 

SPREADING 

GETTERING 

DEFLECTION  YOKE 

PERFORMANCE 

IMPROVE  CONTRAST 

ABERRATIONS 
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components,  is  diagrammed  in  Figure  21.  Although  new  and  promising  alternatives  are  being  investigated 
[18],  nearly  all  ESFL  designs  for  CRTs  use  either;  (l)  bipotential  lenses  or,  (2)  unipotential  or 
einzel  lenses.  In  general,  better  center  resolution  is  achievable  with  bipotential  lens  CRTs  than 
unipotential  lens  CRTs,  because  of  the  more  favorable  beam  diameter  magnification  value  associated  with 
bipotential  lens  designs  [17,18].  A  first  cut  at  determining  the  magnification  and,  therefore,  beam 
spot  size  (ignoring  the  effects  of  the  phosphor  faceplate  system)  may  be  made  as  shown  in  equations  10 
through  12. 
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FIGURE  21 

REPRESENTATIVE  EMD/ESFL  BIPOTENTIAL  LENS  MINIATURE  CRT 


GEOMETRIC  MAGNIFICATION  =  M,  a  Q/P 
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For  the  CRT  shown  in  Figure  21,  which  might  operate  at  an  acceleration  potential  of  13  kilovolts,  and 
nominal  focus  potential  of  2.5  kilovolts,  a  value  for  M-j  of  0.266  is  obtained.  This  value  may  be 
multiplied  by  the  virtual  crossover  diameter,  supplied  by  the  CRT  manufacturer,  to  determine  a  first 
order  approximation  to  spot  size,  ignoring  phosphor/faceplate  system  contributions.  Unipotential 
lenses  give  better  center-to-edge  uniformity  than  bipotential  lenses  [17,18],  This  advantage  can  be 
overcome  by  using  shaped  fiber  optic  faceplates,  which  minimize  deflection  defocusing  and  using  dynamic 
focus  voltage  correction,  which  minimizes  focus  lens  aberrations  while  maintaining  the  significant  spot 
minification  advantage  demonstrated  by  equation  11.  Therefore,  for  the  VPD  HMD  effort,  bipotential 
lens  designs  were  given  primary  emphasis. 

An  accepted  method  of  determining  a  FOM  for  CRT  performance,  which  is  in  essence  one  for  spot  size 
or  resolution,  for  a  given  luminance  level,  is  to  determine  the  RSS  (square  root  of  the  sum  of  the 
squares)  of  the  individual  contributing  factors  to  CRT  spot  sire.  Such  a  relationship,  presented  in 
slightly  different  form  in  many  references  [12,17,18],  and  taken  from  [18],  is  given  in  equation  13. 

For  the  VPD  effort,  the  major  design  emphasis  focused  on  maximizing  the  CRT's  final  anode  potential, 
while  remaining  within  safe  operating  limits,  investigating  the  effects  of  increasing  the  G2  voltage 
and  raising  Gj  cutoff,  maximizing  the  effective  cross-sectional  area  of  the  focus  lens,  improving 
deflection  yoke  characteristics,  and  optimizing  phosphor  grain  size/composition/deposition  techniques. 
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Raising  the  final  anode  potential  effectively  provided  more  luminance  for  the  same  beam  current. 
Utilization  of  a  lower  current,  and  a  higher  voltage  operating  mode  meant  that,  for  particulate 
phosphor  screens,  longer  phosphor  life  was  achieved.  Also,  at  12  kilovolts  or  more,  space  charge 
spreading  effects  became  negligible  with  the  beam  currents  and  beam  travel  distances  found  in  miniature 
CRTs.  However,  the  higher  anode  potentials  meant  a  stiffer  beam  for  the  magnetic  deflection  yokes  to 
steer.  Therefore,  new,  higher  current,  low  inductance/low  capacitance  deflection  yokes  were  designed 
[10].  These  new  yokes  also  run  cooler  at  higher  deflection  coil  currents.  The  deflection  yokes  are 
driven  by  appropriate  highly  linear  deflection  electronics  circuitry  that  can  support  the  high  video 
line  rates,  often  needed  for  VPD  applications. 

Maximum  focus  lens  diameters  and  gun  limiting  apertures  have  been  successfully  implemented  in  an 
integrated  CRT  design  [17,18].  These  improvements  coupled  with  shaped  faceplates,  the  implementation 
of  dynamic  focus  correction  into  the  CRT  drive  electronics,  and  lengthening  the  CRT  slightly  so  that 
the  deflection  yoke  assembly  does  not  overlap  the  focus  lens  element  [10],  have  effectively  reduced 
aberrational/astimatisra  contributions  to  about  10-15  percent  of  the  total  spot  size.  This  may 
represent  a  practical  limit  to  a  reduction  of  these  contributions  to  spot  size,  and  left  only  first 
order  contributions  and  phosphor  screen  effects,  where  further  reductions  might  be  obtained. 


The  major  factors  that  contribute  to  first  order  spot  size  are  interrelated  and  expressed  by 
Langmuir's  equation  (equation  A3.19,  reference  [12]),  as  given  here  by  equation  14.  Its  form  is 
derived  for  narrow-angle  beam  assumptions;  i.e.,  higher  order  contr ibutions  to  spot  size  are 
negligible,  because  the  radial  displacement  and  angle  of  the  beam  are  kept  small  [18].  Equation  14 
then  represents  an  upper  limit  for  display  performance  (ignoring  phosphor  screen  contributions),  and, 
once  a  CRT  has  been  optimized  for  a  given  set  of  operating  character is t ics ,  indicates  the  only  possible 
ways,  that  higher  current  densities  (more  luminance  for  a  given  spot  size)  can  be  achieved.  A  closer 
look  at  equation  14  shows  that  there  are  essentially  four  parameters  which  may  be  varied  to  increase 

Ps  =  pc  [(eV/kT)  +  1]  sin20  (14) 
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peak  current  density  at  the  phosphor  screen;  (1)  increase  the  acceleration  potential,  (2)  increase  the 
angle  of  convergence  at  the  screen,  (3)  reduce  the  operating  temperature  of  the  cathode,  and  (4) 
increase  the  peak  emission  current  capability  of  the  cathode.  The  acceleration  potential  has  already 
been  raised,  and  13  kilovolts  appears  to  be  a  maximum  reliable  operating  potential.  Modifications  to 
the  triode  and  focus  lens  design  within  the  allowed  dimensional  limits  of  miniature  CRTs,  have  also 
brought  the  angle  of  convergence  to  near  its  absolute  maximum.  Therefore,  the  designer  is  left  with 
the  option  of  reducing  the  object  beam  diameter,  A  practical  way  to  accomplish  this  reduction  is  to 

reduce  the  Gj  aperture  (see  Figure  21),  which  increases  the  peak  cathode  loading.  Projections  for  peak 

cathode  loading  in  advanced  CRT  designs  currently  predict  peak  emission  densities  of  5  to  10  araps/cm  , 
which  is  well  above,  that  which  can  be  obtained  for  standard  oxide  cathodes,  providing  reasonable  life 
characteristics  [181.  The  search  for  cathode  designs,  that  can  meet  th^se  operating  requirements  is 
perhaps  the  chief  remaining  breakthrough  to  be  achieved  for  miniature  CRTs  with  the  performance  needed 
to  accommodate  most  VPD  applications. 

The  remaining  area  left  for  obtaining  performance  improvements  is  the  phosphor  screen 
characteristics.  A  significant  impediment  to  past  performance  improvements  in  this  area,  had  been 
knowing  what  the  actual  beam  diameter  was,  just  prior  to  beam  impact  on  the  phosphor.  This  dimension 
could  then  be  compared  to  the  spot  size  of  light,  emanating  from  the  phosphor,  after  impact  of  the 

beam.  At  the  start  of  the  VPD  effort,  AAMRL  had  a  significant  parallel  effort  with  AT&T,  Bell 

Laboratories  to  develop  improved  versions  of  single  crystal  phosphors  (SCP)  that  had  superior  thermal 
characteristics  and  did  not  suffer  coulombic  degradation  which  causes  diminished  light  output  for  the 
same  power  input.  Their  cathodolumiescent  qualities,  also  produced  a  spot  of  light  that  was  almost  the 
same  diameter  as  the  electron  beam  spot,  impinging  on  the  rear  surface  of  the  phosphor  (04).  While 
these  materials  exhibit  superior  contrast  at  all  drive  levels,  they  have  not  produced  the  external 
luminous  efficiencies  originally  hoped  for.  However,  they  have  proven  to  be  very  significant  design 
tools,  and  have  provided  important  technical  insight  into  the  improvement  of  particulate  phosphor  CRT 
screens.  Fabricated  in  split-screen  versions,  where  one-half  of  the  CRT  screen  has  an  activated  SCP, 
and  the  other  half  a  given  formulation  of  a  particulate  phosphor  the  CRT  designer  could  then  know  the 
contribution  to  spot  size  made  by  the  particulate  phosphor  by  measuring  the  change  in  spot  size  as  the 
electron  beam  scanned  across  the  two  media.  This  has  allowed  the  importance  of  a  number  of  particulate 
phosphor  parameters  to  be  investigated,  including;  (1)  the  optimization  of  phosphor  thickness,  and 
therefore,  its  transparency  to  light  generated  by  the  e'beam  for  a  given  acceleration  potential,  (2) 
the  optimization  of  grain  size  mixtures,  to  achieve  high  resolution,  high  luminous  efficiency,  good 
thermal  conductivity  and  good  operating  life  characteristics,  and  (3)  the  evaluation  of  phosphor 
deposition  processes  that  yield  good  percent  coverage  of  the  screen,  and  optimized  phosphor  grain 
packing.  These  processes,  although  much  refined,  are  still  undergoing  further  improvement. 

Figure  22  depicts  the  performance  gains  achieved  for  an  improved  miniature  CRT  developed  as  part  of 
a  joint  AAMRL/Hughes  Aircraft  Company  development  program.  For  the  reference  CRT,  shown  in  Figure  22, 
measured  at  50  percent  peak  luminance  line  widths  of  0.75  mils  (19  microns)  and  1.0  rails  (25.4 
microns),  luminances  of  1100  auu  1300  ft. -Lamberts  were  obtained.  For  the  improved  CRT  measured  at  the 
same  line  width  conditions,  peak  line  luminances  of  approximately  4300  and  7350  ft. -Lamberts 
respectively,  were  achieved. 

The  peak  line  luminance  F0M  is  useful  for  indicating  improvements  made  for  operating  conditions 
that  might  be  expected  of  an  HMD  for  the  presentation  of  symbology  under  daylight  viewing  conditions. 
CRTs  of  this  type  are  also  expected  to  provide  similar  improvements  for  raster  imagery  presentations. 
However,  comprehensive  CRT  measurement  at  different  spatial  frequencies  and  luminance  conditions,  made 
with  CRT  drive  electronics  which  are  capable  of  preserving  the  inherent  performance  of  these  new  CRTs, 
were  not  available  in  time  to  include  here. 

Operating  a  miniature  CRT  at  the  high  luminance,  high  current  levels  indicated  in  Figure  22  does 
exact  a  toll,  primarily  a  shortened  operating  life.  The  current  family  of  improved  CRTs  is  expected  to 
provide  only  70  to  80  percent  of  its  peak  performance  after  400  hours  of  operation.  The  prime  culprit 
appears  to  be  the  emission  characteristics/life  of  the  cathode,  and  not  coulombic  degradation  of  the 
phosphor.  Improved  cathode  materials  and  designs,  such  as  new  low  noise  variants  of  dispenser 
cathodes,  which  operate  at  power  levels  that  do  not  produce  severe  grid  emission,  are  b^ing  sought,  but 
no  clear  replacement  for  refined  high  grade  oxide  cathodes  has  been  firmly  established.  At  the  same 
time,  further  iterations  in  electron  gun  design  and  phosphor  screen  compositions  are  expected  to 
produce  further  improvements  of  at  least  20  percent  above  the  CRT  performance  depicted  in  Figure  22  by 
the  first  half  of  1988. 

INTEGRATED  HELMET  SYSTEM  (IHS) 

GENERAL  CONSIDERATIONS 

During  the  VPD  HMD  development  it  was  determined  that  a  successful  VPD  design  effort  would  require 
the  design  of  a  helmet  which  optimized  the  integration  of  the  optics  and  image  source  components  about 
the  head.  Other  requirements,  such  as  the  need  to  demonstrate  a  helmet  system  that  protected  the  human 
in  hostile  chemical  and  biological  environments,  also  had  an  impact  on  the  types  of  helmet  systems  that 
were  evolved.  Indeed,  probably  almost  all  HMD  applications,  including  narrow  FOV  HMDs,  would  benefit 
substantially  from  a  custom  integrated  helmet  system  design.  A  perfect  example  is  the  Kaiser,  Inc. 
"Agile  Eye"  helmet  system  which  incorporates  a  helmet  position/orientation  system  and  a  HMD,  which  can, 
for  two  different  design  variants,  provide  a  monocular  visor  projected  display,  with  an  instantaneous 
circular  FOV  of  either  12  or  20  degrees.  Because  of  the  small  FOV,  this  system  was  able  to  improve 
upon  helmet  weight  and  CG  characteristics  currently  found  in  unmodified  operational  flight  helmets 
intended  for  use  in  fighter  aircraft. 

For  the  VPD  effort,  the  integrated  helmet  design  attempted  to  provide  the  necessary  operational 
safety  while  minimizing  weight  and  optimizing  CG,  enhance  the  operation  of  VPD  components,  minimize 
the  impact  of  environmental  factors  on  the  visual/auditory  functions,  and  as  possible,  provide  the 


4.5 


s 


IBEAm  (MICROAMPS) 


IMPROVED  CRT  (DEC  86) 

ANODE  13KV 

□ - LIGHT  OUTPUTS 

O - LINE  WIDTH 

50%  PEAK 


REFERENCE  CRT  (DEC  85) 

ANODE  12KV 

0 - LIGHT  OUTPUTS 

© - LINE  WIDTH 

50%  PEAK 


FIGURE  22 

COMPARISON  OF  MINIATURE  CRT  PERFORMANCE  IMPROVEMENTS 

necessary  comfort  for  extended  periods  of  wear.  Design  features  and  considerations  that  proved  to  be 
most  important  to  the  successful  integration  of  each  optical  system  design  were  as  follows: 

1)  The  select,  n  performance  of  the  HMD  optics  design 

2)  The  helmet/opt ics  head  stabilization  methodology 

3)  Helmet/optics  interface  issues  affecting  adjustment  capability  for  the  optics 

4)  Basic  helmet  design  alternatives 

SELECTION  OF  HMD  OPTICS  DESIGN /PERFORMANCE 

The  selection  of  a  particular  optical  design  configuration  is  just  as  important  as  its  required 
performance  in  its  effects  on  the  effectiveness  of  the  final  system  hardware.  The  selections  made 
often  affect  head/helmet  CG  more  than  weight.  Figure  23  illustrates  the  most  feasible  HMD  optical 
system  conf igurat ions.  The  location  of  the  optical  system's  head-mounted  image  sources  imply  a 
particular  relay  optics  design  to  bring  the  image  to  the  human's  eyes.  Location  1,  which  indicates  a 
mounting  location  anywhere  across  the  top  or  crown  of  the  helmet,  permits  a  reasonably  simple  and  short 
relay  optics,  but  results  in  a  significant  modification  of  the  head/helmet  CG  and  a  "topheavy"  feeling. 
Locations  2  and  3  still  normally  utilize  relay  optics  of  modest  complexity,  but  are  located  lower  on 
the  head,  and  have  a  lesser,  but  still  significant  (especially  location  3)  effect,  on  head/helmet  CG.  A 
problem  with  location  2,  is  that  it  normally  occludes  peripheral  vision,  and  therefore,  necessary 
peripheral  motion  cues  that  are  important  to  military  pilots  during  the  performance  of  low  level  and 
hovering  flying  tasks.  One  noteworthy  advantage  of  location  3  is  that  it  provides  the  optimal  path  for 
achieving  large  HMD  vertical  FOVs.  However,  it  also  presents  a  more  difficult  problem  for  eliminating 
stray  images  emanating  directly  from  the  relay  optics  to  the  eyes.  Location  4  provides  an  optimal 
location  for  achieving  "operationally  positive"  modifications  to  the  head  helmet  CG,  but  results  in 
excessive  helmet  weight  for  a  given  FOV.  This  happens  because,  in  supporting  the  high  resolution/ large 
FOV  operating  conditions,  either  heavy  refractive  optics  or  fiber  optic  image  conduits,  must  be  used  to 
relay  the  CRT  images  to  the  eyes.  Location  5  presents  a  compromise  that  permits  shorter  fiber  optics 
conduits  or  reasonably-sized  high  efficiency  refractive  relay  optics  to  be  used,  while  still  resulting 
in  a  head/helmet  CG  modification  that  is  altered  in  a  desirable  direction.  Normally,  location  5 
employs  a  refractive  relay  optics  design,  that  carries  the  CRT  image  up  and  over  the  ear,  to  the 
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display  combiner  without  significantly  occluding  peripheral  vision.  The  VPD  helmet  systems  described 
in  this  paper  have  made  use  of  only  mounting  locations  1,  3,  and  5. 


FIGURE  23 

IHS  MOUNT I HG  LOCATIONS  FOR  VPD  HMD  COMPONENTS 

The  alteration  of  head/helmet  CG  is  a  critical  parameter  if^ecting  the  selection  of  thw  HMD  optical 
design.  The  VPD  program  is  now  in  the  breadboard  stage,  where  designs  and  materials  are  fluctuating, 
and  it  has  not  been  possible  to  predict  head/helraet  CG  modifications,  based  upon  dimensional 
predictions  of  helmet  re lationships  and  the  densities  of  the  materials  used.  Instead,  the  breadboards 
are  being  completed,  and  then  the  Ma«s  Properties  Instrument  built  by  Space  Electronics,  tnc.  and 
located  at  AAMRL,  is  being  used  to  measure  the  center  of  mass/gravity  and  determine  mass  moments  and 
products  of  inertia.  These  measurements  will  then  be  used  to  predict  CG  based  upon  desired 
modifications  to  a  given  design,  as  improved  systems  are  fabricated  for  operational  testing. 

One  additional  important  consideration  that  can  have  a  direct  impact  on  integrated  system  design  is 
the  susceptibility  of  the  optical  design  to  stray  light.  Stray  light  path9  can  produce  unwanted 
reflections  of  ambient  structures  within  the  HMD  FOV  that  compete  in  a  very  objectionable  manner  with 
the  display  imagery.  The  two  major  factors  affecting  this  problem  are  the  selection  of  the  image  path 
for  a  particular  optical  design,  and  the  eye  relief  provided  for  the  display's  combiner.  Greater  eye 
relief  leads  to  raor'.  severe  problems.  Light  originating  from  behind  helmet,  or  overhead  otten  presents 
the  most  severe  problem.  These  problems,  cannot  be  fully  corrected  through  the  use  of  ant i re f lec t i ve 
coatings,  and  usually  require  the  addition  of  opaque  sections  around  the  optics  or  the  extension, 
and/or  thickening  of  the  helmet  shell/liner  combination,  to  block  objectionable  stray  light  paths. 

HELMET  STABILIZATION 

The  inclusion  of  relatively  large  exit  pupils  and  IPD  adjustment  in  the  opt ics /he  1  met  design  is  not 
enough  to  insure,  during  normal  viewing/operating  conditions,  that  the  helmet  system  will  not  move 
sufficiently,  thus  vignetting  a  portion  of  the  display's  instantaneous  FOV.  Therefore,  some  sort  of 
stabilization  scheme  must  be  incorporated.  While  there  are  several  options,  the  approach  chosen  for 
the  VPD  HMD  effort  was  one  which  incorporated  an  oxygen  mask  that  could  be  rigidly  he*d  with  respect  to 
the  rear  portions  of  the  helmet,  as  suggested  by  the  helmet  concept  illustrated  in  Figure  23.  This 
arrangement  allows  a  rigid  lever  arm  to  be  formed,  between  the  nape  of  the  neck  and  the  bridge  of  the 
nose,  that  resists  both  vertical  and  sideways  movement  of  the  helmet.  This  scheme  has  proved  to  be 
very  successful,  and  eliminates  most  helmet  position  hysteresis  following  rapid  head-slaving  movements. 
Comfort/facial  access  must  also  be  considered,  and  most  designs  allow  a  mask  design  that  can  be  opened 
to  one  9ide,  although  a  design  employing  mounting  location  3  sometimes  effectively  eliminates  this 
option.  An  additional  benefit  of  this  type  of  helmet  design  is  that  the  optical  design  and  associated 
adjustment  requirements  may,  through  the  rigid  mask  design,  be  referenced  to  the  bridge  of  the  nose. 
This  scheme  offers  one  of  the  most  stable,  reliable  reference  methods  for  the  eyes,  given  human 
anatomical  characteristics. 
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BKLMKT/OPTICS  INTERFACE  ISSOKS 

Three  types  of  adjustments  must  be  provided  to  properly  position  the  optics  with  resect  to  the 
eyes:  horizontal  (IPD),  vertical,  and  depth  (eye  relief)  adjustments.  IPD  requirements  -u  -ve  already 

been  discussed  in  sufficient  detail,  except  to  stress  that  the  helmet  system  must  permit  separate 
independent  adjustment  of  each  monocular,  and  the  adjustment  must  be  parallel  and  col  inear  to  insure 
that  misalignment  of  the  binocular  scene  does  not  occur  for  different  adjustment  points,  anywhere  in 
the  allowed  range  of  movement.  Vertical  and  depth  adjustments  imply  a  personalized  custom  mounting 
scheme.  For  the  VPD  designs,  this  has  been  accomplished  through  the  use  of  a  custom  "thermal  plastic 
liner  (TPL),"  developed  by  Gentex,  Inc.,  and  inflatable  air  bladders  whose  internal  pressure  may  be 
controlled  through  the  use  of  a  miniature  helmet-mounted  finger  pump  and  valve  assembly,  operated  while 
viewing  alignment  patterns  on  the  display  optics.  Investigations  aimed  at  determining  whether  this 
mounting/ad justment  technique  provides  the  desired  amount  of  stability  and  comfort  are  ongoing.  Major 
features  of  the  VPD  IHS  are  depicted  in  Figure  24. 


FEATURES: 

1.  LIGHT  WEIGHT  KELVAR  SHELL  A.  PROTECTIVE  POLYCARBONATE  VISOR  8.  AIR  HOSE  CONNECTOR 

2.  PLENUM  (PART  OF  LAYERED  SHELL.  5-  OXYGEN  MASK  ASSEMBLY  9.  FINGER  AIR  PUMP  FOR  EARPHONE/ 

AIR  DUCT  FOR  VENTILATION)  6.  HEADPHONE  EAR  CUP  ASSEMBLY  DISPLAY  ADJUSTMENT  BLADDERS 

3.  STYROFOAM  LINER  7.  TPL  CUSTOM  FITTED  LINER  10.  EARPHONE  ADJUSTMENT  BLADDER 

11  VERTICAL  AD  <USTMEN‘r  BLAD0ED 

FIGURE  24 

IHS  HELMET  SYSTEM  CHARACTERISTICS 

HELMET  DESIGN  ALTERNATIVES 

The  integration  of  the  VPD  optical  prototypes  into  representative  military  headgear  systems,  using 
advanced  lightweight  Kevlar  shells,  has  resulted  in  a  number  of  interesting  helmet  configurations. 
These  designs  were  driven  by  a  number  of  considerations,  including  the  desire  to  achieve  the  largest 
FOV/exit  pupil  for  a  given  HMD  design  approach,  expected  operational  conditions  in  flight  test 
aircraft,  abuse  that  normal  personal  equipment  undergoes,  difficulties  with  doning  complex  helmet 
systems  of  this  type,  safety,  particularly  for  rapid  egress  from  a  damaged  air  vehicle,  and  the 
physical  properties  of  the  .lesigns  as  discussed  for  CG,  etc.  Several  of  the  more  interesting  IKS 
breadboards  are  presented  here  in  Figures  25,  26,  and  27  for  systems  3,  2,  and  5  respectively,  from 
Table  2. 

The  Dual  Mirror  system,  Figure  25,  provides  the  second  largest  FOV  of  any  of  the  designs  and 
achieves  the  lowest  optical  system  weight.  Its  design  16  closely  integrated  with  the  oxygen  mask, 
which  aids  in  referencing  the  optical  alignment  to  the  eyes,  but  complicates  the  ability  to  remove  the 
mask  when  the  helmet  is  worn.  The  close  integration  with  the  mask,  led  to  a  rear  entry  design,  which 
eliminates  cumbersome,  overhead  doning  of  the  helmet  and  streamlines  the  placement  of  the  oxygen  mask 
and  optics  over  the  face.  The  folds  and  contours  of  the  helmet  shell  at  its  base  provide  rigidity, 
while  reducing  the  number  of  Kevlar  plys  which  must  be  used.  The  thickness  of  the  helmet  liner  has 
been  increased  to  provide  improve  headform  acceleration  performance,  and  to  reduce  unwanted  reflections 
in  the  beamsplitter  due  to  stray  light  originating  from  above  and  behind  the  helmet. 

The  Catadioptric  system,  shown  in  Figure  26,  has  a  10  percent  smaller  FOV  than  the  Dual  Mirror 
system,  but  provides  much  greater  eye  relief  and  improves  image  source  transmission  efficiency  by  3 
factor  of  three.  The  improved  eye  relief  and  image  source/optics  integration  achieves  a  design,  that 
permits  the  optics  and  image  source  assembly,  to  be  detached  from  the  helmet  and  stowed  in  the  cockpit. 
Such  a  design  prevents  an  expensive  assembly  from  becoming  a  piece  of  personal  equipment  subject  to 
greater  abuse.  However,  this  capability  is  gained  at  the  expense  of  increased  helmet  weight  and 
rotational  moments,  and  stray  light  problems  resulting  from  a  Large  combiner/beamsplitter  assembly 
located  a  relatively  large  distance  from  the  helmet.  Upward  vision,  in  particular,  is  greatly 
restricted,  to  prevent  severe  overhead  stray  light  problems. 
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FIGURE  26 

PROTOTYPE  CATADIOPTRIC  OPTICS /HEADGEAR  BREADBOARD 


The  Off-Aperture  system,  shown  in  Figure  27,  depicts  yet  another  novel  optical  syscem/he Imet  design 
approach.  This  design  iocates  the  CRT  image  sources  vertically,  at  the  rear  of  the  helmet,  to  improve 
the  head/helmet  CG  characteristics.  This  location  precludes  a  rear  entry  design,  but  its  lack  of 
direct  involvement  with  the  stabilizing  oxygen  mask  permits  the  mask  to  be  removable  when  the  helmet 
system  is  worn.  The  design  utilizes  a  high  efficiency  refractive  optical  design  to  transport  the  CRT 
image  to  the  combiner  mirror  viewing  surface.  This  permits  achieving  image  source  transmission 
effi  :eneies  of  80  to  85  percent,  and  also  allows  greater  ambient  transmission,  while  providing  good 
image  contrast.  Excellent  eye  relief  and  clearance  are  also  characteristics  of  this  design.  However, 
system  weight  is  high,  although  use  of  plastic  optics  and  other  system  refinements  could  greatly 
improve  this  condition. 
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FIGURE  27 

PROTOTYPE  OFF-APE RTDRE  OPT ICS /HEADGEAR  BREADBOARD 
IMAGE  SOURCE  DRIVE  ELECTRONICS 

Although  sometimes  given  secondary  consideration,  the  image  source  or  CRT  drive  electronics,  which 
controls  the  binocular  optics  CRTs  as  shown  in  Figure  1,  are  extremely  important  components,  for  VPD 
HMD  applications.  Their  performance  is  a  fundamental  factor  in  the  modulation  transfer  function  (MTF) 
that  the  CRT  can  attain.  The  drive  electronics  also  control  most  of  the  important  factors  relating  to 
the  customization/integration  of  the  CRT  formats  with  respect  to  the  optical  design.  For  this  paper,  a 
relevant  discussion  of  design  issues  need  only  concern  itrelf  with  those  factors,  which  are  critical  to 
the  proper  integration  of  the  CRTs  and  their  image  formats,  with  the  optics  and  headgear.  The  issues  of 
greatest  importance  are  felt  to  be: 

1)  CRT-to-opt ic8  mapping  correction 

2)  Derotation 

3)  Electronic  alignment 

A'  n*-ho*-  oot  x ; Y  Deflection  issues 

5)  Power  Supply  performance 
CRT-TO-OPT ICS  MAPPING  CORRECTION 

As  the  discussion  associated  with  Figure  17  has  already  explained,  the  F-theta  mapped  optics 
produces  a  type  of  pincushion  distortion  which  must  be  corrected  by  i  rapl  emcr.1  ir.to  barrel  distortion  of 
the  CRT  image  format.  As  mentioned  in  [01,02),  partially  overlapped  optics,  which  have  their  optical 
axes  turned  out,  can  also  produce  mild  perspective  distortion  which  is  trapezoidal  in  form. 

Ordinarily,  such  distortions  could  be  specified  by  the  optical  designer,  and  the  system  designer  could 
insert  the  appropriate  corrections  using  a  truncated  polynomial  approximation  with  sufficient 
correction  terms  in  dedicated  correction  circuitry  associated  with  the  deflection  subsystem.  However, 
given  the  variation  experienced  between  individual  CRT  electron  optics,  the  deflection  yoke,  and  the 
physical  alignment  of  the  deflection  yokes  with  the  electron  optics  during  the  manufacturing  process, 
these  ideal  conditions  cannot  be  obtained.  Therefore,  each  CRT  must  be  calibrated  for  the  particular 
HMD  design,  and  the  correction  coefficients  recorded  and  entered  into  the  control  elements  of  the  CRT 
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electronics.  Normally,  correction  terras  to  third  order  are  sufficient,  which  is  fortunate,  since  each 
additional  order  implies  a  commensurate  increase  in  deflection  electronics  bandwidth  [221.  The 
correction  terras  most  often  used  are  listed  in  Table  b.  Their  respective  effects  on  the  CRT's  X  and  Y 
axis  can  be  found  in  reference  [07]. 

TABLE  6 

CAT  MAPPING  CORRECTION  TERMS 


X-AXIS  DEFLECTION 

Y-AXIS  DEFLECTION 

X2,  Y2,  XY2,  X2Y:,  X3,  Y3 

XY,  X2,  Y2,  X2Y,  X2Y2.  X3,  Y3 

DEROTATION 

For  HMD  applications  it  is  sometimes  desired  that  the  display  format  be  maintained  at  the  proper 
orientation  with  respect  to  the  aircraft's  or  simulator’s  roll  axis,  regardless  oc  the  roll  orientation 
of  the  head,  and  therefore,  the  display  presentation.  Maintaining  the  proper  orientation  is  usually 
accomplished  through  the  use  of  roll  sensing  provided  by  a  helmet  orientation/position  measurement 
system  whose  roll  output  is  fed  directly  to  the  drive  electronics  or,  if  a  2  or  3-dimensional  graphics 
processor  is  being  used,  directly  to  that  subsystem.  As  shown  in  Figure  6,  for  a  partially  overlapped, 
binocular  system,  the  visual  center  of  the  optics  is  off  center  from  the  CRT,  and  the  derotation  to  be 
performed  involves  both  a  translation  and  derotation  on  the  CRT.  Particular  characteristics  are  set  by 
Che  VPO  design  conditions.  This  correction  must  be  performed  at  the  field  rate,  at  which  the  display 
is  refreshed.  The  resolution  to  which  this  correction  must  be  accomplished  has  already  been  discussed 
in  su.ficient  detail  in  reference  (22).  Due  to  noise  and  bandwidth  considerations  in  the  display 
deflection  electronic's  subsystem,  and  system  implementation  issues  concerning  the  use  of  sensor 
systems,  derotation  of  imagery  is  usually  performed  by  the  CRT  electronics.  Derotation  of  vec  or 
graphic  symbology  is  best  accomplished  at  its  source,  and  then  transmitted  in  corrected  form  to  the  CRT 
drive  electronics. 

ELECTRONIC  ALIGNMENT 

As  previously  discussed,  some  electronic  alignment  must  be  performed,  to  correct  for  residual 
errors  in  the  alignment  of  the  optics  and  in  the  reproducible  character  ist ics  of  individual  CRTs. 
Although  complex  alignment  patterns  have  been  employed  to  carefully  chec1'  the  •'••act  horizontal/ 
vertical  alignment  of  partially  overlapped  binocular  displays,  the  simple  patterns  shown  in  Figure  28a 
and  28b  are  usually  sufficient.  The  pattern  shown  in  Figure  28a  has  been  recommended  in  the 
literature,  however  t  e  pattern  shown  in  Figure  28b  appears  to  produce  better  results,  because  there 
are  no  identical  structures  presented  to  both  eyes  which  the  eyes  might  attempt  to  converge  to 
identical  retinal  correspondence  points.  In  addition,  the  pattern  shown  in  28b  provides  exact  endpoint 
match  capability,  not  provided  by  some  of  the  open  reticle  patterns,  which  provide  onlv  horizontal 
lines  to  one  eye  and  vertical  lines  to  the  other.  Also,  results  obtained  at  AA.MRL  show  that  these 
patterns  must  be  flashed  in  order  to  prevent  improper  convergence  of  the  display.  A  duty  cycle  pattern 
that  seems  to  work  well  is  to  repetitively  flasn  the  patterns  on  for  about  75  milliseconds,  followed  by 
a  100  to  125  millisecond  dark  period. 

OTHER  CRT  DEFLECTION  ISSUES 

In  addition  to  issues  relating  to  CRT  X:Y  deflection  quality,  a  number  of  other  issues  are 
deserving  of  some  discussion.  Due  to  the  high  resolution  magnified  CRT  format  imposed  by  the  VPD  FOV 
conditions,  where  the  same  image  point  is  transmitted  to  each  eye  through  different  portions  of  a 
partially  overlapped  optical  system,  on-axis  deflection  Linearity  is  critical.  Linearity  is  usually 
specified  to  be  in  the  range  of  0.5  to  0.25  percent.  To  achieve  such  linearity  with  miniature  CRTs,  a 
class-A  linear  deflection  amplifier  design  is  normally  required.  Class  A  amplifiers  cause  heat 
dissipation  to  become  an  iraprrtant  design  issue.  VVD  CRT  design  which  stresses  higher  acce 1 erat i on 
potent i >ls  and,  therefore,  stiffer  e-beams,  exacerbates  this  problem.  To  support  this  performance,  low 
capacitance  cabling  and  low  inductance/capacitance,  high  current  deflection  yokes  using  only  ferrite 
cores  are  employed.  These  requirements,  coupled  with  the  desire  to  achieve  small  dimensional  sizes  for 
the  electronics,  often  requires  the  use  of  conductive  liquid  cooling,  rather  than  ronvective  air 
cooling  for  the  CRT  electronics. 

Also,  as  can  be  observed  from  Figure  6,  the  CRT  is  overscanned  in  the  horizontal  direction  to  (I) 
obtain  the  largest  format  possible  for  the  normal  4:3  aspect  ratio,  and  to  (2)  ease  the  optical  design 
problem.  To  prevent  damage  at  Che  edge  of  the  CRT  caused  by  electron  beam  heating,  the  beam  must  be 
blanked  (turned  off)  automatically  at  a  given  radial  distance,  u9ing  an  operating  mode  normally 
referred  to  as  "circular  blanking".  The  extinction  of  the  e-beam  is  controlled  by  the  magnitude 
(|X+Y|)  of  its  radial  distance  from  Lhe  deflection  center  of  the  CRT,  based  upon  CRT  quality  area  size 
and  any  additional  deflection  correction  control  that  is  active.  There  are  several  methods  employed  to 
accomplish  circular  blanking,  however,  methods  that  employ  slow  square  root  circuitry  are  to  be 
avoided . 
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FIGURE  28 

BINOCULAR  DISPLAY  ALIGNMENT  PATTERNS 


POWER  SUPPLY  PERFORMANCE 

ific  H ’•!.')  optics  -Minify  the  CKf  faceplate  imagery,  from  8  to  IV  C  t  m  t*  that  of  the  original  imagery. 
M.lgn  i  f  icat  ions  of  this  order  aft?  sufficient  to  make  electron  beam  spot,  noise,  raster  line  jitter  and 
Irive  «•  I  *■»'  t  mi!  i  ;s  power  supply  noise  b..t)i  noticeable  and  objectionable.  This  makes  power  supply  noise 
till  regulation  specifications  very  important. 

The  interaction  of  the  CRT  drive  electron! ?*s  power  supply  noise  and  ripple  with  the  disnlav 
imagery,  can  produce  complex  effects.  These  artifacts  produce  movement  of  the  display  imagery  visible 
r.  the  human  operator,  depending  upon  their  freijuency  and  amplitude  as  a  function  of  angular  subtense 
on  the  display.  This  is  particularly  true  for  military  power  supplies,  that  utilize  high  frequency 
switching  L-signs.  As  an  example,  consiler  the  implementation  of  a  1225  line,  2:1  interlace  scan 
f  >rmat  on  an  HMD  with  a  *>;)  degree  horizontal  KOV.  The  scan  line  "on  rime"  for  a  1225  line  rate  is 
ippr  «.<i  mate  l  y  2  J.8  m  icrosec-mds,  which  implies  that  one  degree  on  the  display  equals  about  O.S 
micro-seconds.  Since  visual  contrast  sensitivity  peaks  at  about  1  to  s  cycles  per  degree,  a  switching 
pow-.-r  supply  with  a  ripple  frequency  of  »>  to  8  megahertz  has  a  switching  frequency  that  could  rinse 
cyclical  patterns  where  the  eye  is  most  sensitive.  Alternately,  a  switchii.g  .supply  operating  at  50") 
kilohertz,  may  bo  sufficiently  removed,  if  ripple  amplitude  is  low  enough,  to  moderate  such  effects. 
The  point  here  is  that  interactions  of  this  type  should  be  thoroughly  investigated  for  all  anticipated 
>perarir>c  cond  i  t  i<>n*. 

The  aLili*"  to  obtain  the  needed  performance  is,  in  turn,  dependent  upon  the  specification  of  a 
reasonable  set  of  CRT  voltages,  adjustment  ranges  for  those  voltages,  and  the  maximum  operating 
currents  th.at  are  allow'd.  Table  7  provides  a  set  of  spec  i  f  i  cat  i  ons  for  the  latest  CRT  losigns  that 
provide  operating  margins  which  permit  minimal  power  supply  noise  and  regulation  requirements  to  be 


TABLE  7 

CRT  ORIVfc  ELECTRONICS  POWER  SUPPLY  REQUIREMENTS  FOR  IMPROVED  STD  B l POTENTIAL  GUN  CRT 


PARAMETER 

VOLTAGE 

VOLTS 

MIN  MAX 

CURRENT 

MICROAMPS 

MIN  MAX 

RIPPLE 
AND  NOISE 

REGULATION 

ANODE  (SCREEN! 

to. 000  j 

>3.500 

00  1 

300 

<0  05°: 

<0  !r 

G.  (FOCUS) 

1000  '■ 

3000 

00  I 

1  000 

<00 5-. 

<0> 
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500  ( 

I.  -  1 
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on  I 
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<  0  05 5 1 
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SUMMARY 

This  paper  outlines  the  main  design  of  the  cockpit  of  the  EAP  (Experimental 
Aircraft  Programme)  aircraft  -  a  technology  demonstrator  produced  by  British  Aerospace 
and  Aeritalia  in  cooperation  with  the  British,  Italian  and  German  Avionics  Industries. 
The  structured  design  process  that  was  followed  is  described.  The  main  features  of  the 
resulting  cockpit  are  outlined,  together  with  some  of  the  rationale  behind  their  design 
These  include: 

Display  moding:  how  the  format  hierarchy  is  managed,  how  the  formats  were 
constructed  and  how  colour  has  been  used  on  the  displays.  A  selection  of  the  formats 
are  illustrated  and  described. 

The  Hands  On  Throttle  And  Stick  concept  and  how  this  applies  to  the  EAP. 

A  Manual  Data  Entry  facility  capable  of  controlling  ten  different  subsystems 
through  totally  multifunction  devices. 

An  intelligent  warning  system  based  on  the  use  of  a  digitised  voice. 

These  facilities  have  been  flying  for  over  one  year  now  and  the  experience  gained 
during  their  design  and  subsequent  flight  testing  is  helping  to  form  the  basis  for  the 
European  Fighter  Aircraft  ( EFA )  cockpit  design. 


1.  INTRODUCTION 

In  the  late  seventies  and  early  nineteen  eighties  various  European  companies  were 
pursuing  national  designs  for  a  future  fighter  aircraft.  In  1982  British  Atmsi.ace  of 
Great  Britain,  Aeritalia  of  Italy  and  MBB  of  West  Germany  joined  forces  to  investigate 
the  possibilities  cf  producing  a  joint  specification  to  meet  their  individual  national 
requirements.  Work  progressed  over  the  next  year  on  this  collaborative  aeroplane  known 
as  the  Agile  Combat  Aircraft,  A.C.A.,  with  t.he  intention  of  producing  two  demonstrator 
aircraft,  one  to  be  built  in  Britain  and  the  other  in  Germany.  However  towards  the  end 
of  1983  Italian  and  German  government  support  was  withdrawn  and  work  on  the  Gorman 
aircraft  was  curtailed.  The  design  of  the  remaining  British  demonstrator  was  rationalised 
and  at  the  beginning  of  1984  the  project  was  renamed  the  Experimental  Aircraft.  Programme 
or  EAP.  The  project  was  jointly  funded  by  British  Aerospace  and  the  British  government 
with  support  from  Aeritalia  and  the  British,  Italian  and  German  avionics  suppliers. 

Work  progressed  between  these  industrial  partners  over  the  next  i-  ./o  and  a  half  y«»ars  to 
achieve  a  first  flight  of  the  EAP  in  August  1986.  A  photograph  of  the  EAP  aircraft  can 
be  found  in  Annexe  1. 

The  aim  of  the  EAP  was  to  integrate  a  number  of  advan.  3  concepts  and  technologies 
into  a  single  aircraft  to  demonstrate  the  feasibility  of  a  high  performance  fighter  of 
the  1990s.  These  concepts  included: 

advanced  structural  design 

active  control  technology 

a  utilities  management  system  and  an  avionics  system  utilising  a  Mil  Std  15r>3b 

data  bus 

an  advanced  electronic  cockpit 

It  is  the  description  of  this  last  point  which  forms  the  basis  of  this  paper. 

2.  THE  EAP  COCKPIT  PHILOSOPHY 

The  basic  cockpit  configuration  can  bo  seen  from  the  diagram  in  figure  1.  The  twenty 
five  degree  ejection  seat,  providing  a  pilot  back  angle  of  twenty  one  degrees,  faces  a 
wide  angle  head  up  display  and  three  full  colour  raster/cursivo  multifunction  head  down 
displays.  These  displays  are  used  under  normal  conditions  to  present  to  the  pilot  a  LI  the 
information  he  requires  to  fly  and  manage  the  aircraft.  However  should  there  be  a 
catastrophic  failure  resulting  in  tiie  total  loss  of  these  displays,  the  pilot  is  provided 
with  a  suite  of  ’Get-U-Home'  instruments  which  present  the  necessary  flight  reference, 
engine  and  fuel  data  via  a  mixture  of  display  technologies,  LCD,  LED  etc.  Forming  the 
left  glare  shield  is  a  multifunction  manual  data  entry  facility  to  allow  in  flight 


msi'M ion 'a  1 1 oration  of  navigation,  communications  etc.  data.  Flight  control  of  the 
aircraft  is  allowed  by  a  centre  pedestal  mounted  short  stick,  minimum  displacement  rudder 
pedals  anil  linear  slider  throttles.  This  entire  cockpit  has  been  designed  to  be  operable 
by  a  pilot  falling  within  the  three  to  ninety  nine  percentile  UK  and  Italian  pilot 
popu l at  ion . 


FIGURE  1  :  BASIC  EAP  COCKPIT  CONFIGURATION 


The  EAP  is  not  a  weapon  system  aircraft,  it  is  a  technology  demonstrator,  however 
it  was  the  intention  from  the  beginning  that  within  the  cockpit  the  concepts,  in  terms 
of  the  man  machine  interface,  be  developed  with  consideration  of  the  implications  of  a 
full  weapon  system.  The  aim  was  to  develop  philosophies,  for  such  things  as  moding  the 
electronic  displays  and  the  warning  system,  which  would  allow  future  graceful  expansion 
to  include  the  greater  complexity  of  a  more  sophisticated  attack  and  identification 
system,  without  significant  changes  to  hardware  and  with  no  change  to  cockpit  operating 
phi losophies . 

The  advent  of  high  performance  systems  processors  and  the  digital  data  bus,  together 
with  new  cockpit  technologies  such  as  colour  displays,  multifunction  panels  and  digitised 
voice,  meant  that  the  potential  design  that  could  be  achieved,  in  terms  of  flexibility, 
was  staggering.  However  equally  staggering  was  the  potential  to  create  an  unmanageable 
cockpit  caused  by  ’technology  gone  mad'. 

It  was  this  fear  of  'technology  gone  mad*  which  made  it  essential  that  the  ergonomic 
aspects  of  the  design  should  be  considered  at  all  stages  and  in  fact  ergonomic  implications 
formed  an  integral  part  of  the  design  process. 

This  design  process  followed  a  top  down  structured  approach  that  began  with  Mission 
Analysis.  The  Mission  Analysis  provided  the  bulk  of  the  raw  material  required  for  the 
detailed  moding  process,  however  before  tile  detailed  moding  began  various  cockpit: 
philosophies  were  written  which  set  out  the  principles  behind  the  cockpit  design.  Such 
philosophies  are  necessary  to  establish  a  basis  for  the  cockpit  design  ♦'hat  ensures  that 
the  subsequent  detailed  design,  which  involves  greater  numbers  of  people,  follows  a 
consistent  and  logical  path.  On  EAF  they  were  of  additional  value  to  establish  basic 
principles  for  the  implementation  and  integration  of  the  new  technology  into  one  cockpit  - 
something  that  was  necessary  due?  to  the  lack  of  practical  experience  that  was  available. 
These  philosophies  covered: 

-  Display  Moding 

Hands  on  Throttle  and  Stick 
Manual  Data  Entry 

-  Warning  System 

Cockpit  Layout 
Lighting 

-  Colour 

-  Get-U-Home 
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These  cockpit  philosophies  were  a  fundamental  first  step,  however  they  were 
theoretical  and  it  was  considered  that  an  important  factor  in  trying  to  design  a  cockpit 
for  pilots,  rather  than  engineers,  was  to  adopt  an  empirical  approach.  Therefore  the 
principles  outlined  within  these  philosophies  were  soon  manifested  into  various  forms  of 
simulation,  the  main  vehicles  being  a  static  cockpit  mock-up  facility  and  an  active 
cockpit . 

The  static  mock-up  (see  pl.o-ograpn  in  AnncA«_  2 ,  .. a  /.ccdr*n  <-r>nVnit  which  formed  an 
accurate  representat ion  of  the  current  aircraft  lines.  it  was  used  extensively  lo  design 
and  evaluate  the  cockpit  geometry  and  layout  -  the  hardware  aspects  of  the  man  machine 
interface . 

The  active  cockpit  (see  photograph  in  Annexe  J)  on  the  other  hand  provided  a 
functionally  representaive  simulation  of  the  cockpit  displays  and  controls  and  was  used 
more  to  develop  the  software  driven  aspects  of  the  cockpit.  Initially  local  simulations 
were  produced  of,  for  example,  the  Manual  Data  Entry  Facility  or  the  Warning  System  and 
these  were  assessed  in  isolation.  Once  these  individual  aspects  were  considered 
satisfactory  they  were  driven  dynamically,  backed  up  by  simulations  of  the  various 
aircraft  subsystems  and  the  outside  world.  At  this  stage  the  various  elements  (formats, 
warnings,  layout  etc.)  were  brought  together  and  the  overall  moding  assessed  during  part 
and  full  mission  simulation.  Throughout  all  these  stages  the  simulations  were  feeding 
into  the  design  process.  This  is  perhaps  one  of  the  biggest  lessons  which  can  be  learned 
from  the  undoubted  success  of  EAP  -  that  is  that  facilities,  such  as  static  and  active 
cockpits,  be  available  at  a  sufficiently  early  stage  in  a  project  to  have  an  impact  on 
both  the  hardware  and  software  specifications. 

Jt  is  the  design  which  initially  resulted  from  these  philosophies  and  that  was 
developed  and  refined  through  practical  experience  in  the  various  simulations,  that  forms 
the  EAP  cockpit  as  presented  on  the  following  pages. 

1.  DISPLAY  MODING 

All  the  main  flight  reference,  navigation  and  systems  information  on  EAP  is  presented 
'o  the  pilot  using  electronic  displays,  in  the  form  of  a  Head  Up  Display  (HUD) 

(30  x  20  degrees)  and  Multi  Function  Displays  (MFD)  (154  mm  x  116  mm)  head  down. 

In  order  to  successfully  integrate  these  displays  within  the  overall  cockpit  moding, 
certain  aims  were  established  early  on  in  the  EAP  programme.  These  aims  were: 

To  present  information  to  the  pilot  in  a  relatively  simple  manner.  The  pilot  in  the 
midst  of  a  demanding  mission  cannot  be  faced  with  an  overly  complex  picture  and  symbology, 
but  requires  fairly  obvious  and  straightforward  information. 

To  display  what  the  pilot  needs  to  know.  This  does  not  mean  solely  that  information 
relating  to  functions  under  pilot  control.  It  is  important  that  the  pilot  always  has  a 
mental  picture  of  where  he  is  -  both  within  the  outside  world  scenario  and  within  the 
various  cockpit  processes.  The  information  presented  on  his  displays  should  provide  him 
with  this  impression  so  that  lie  can  assume  the  role  of  an  overall  manager. 

To  make  the  overall  structure  of  the  format  hierarchy  easy  to  manage.  it  could  be 
very  easy,  with  a  suite  of  mu  1 1 i f unct ion  displays  which  arc  capable  of  providing  a 
multitude  of  formats,  to  produce  a  format  hierarchy  in  which  the  pilot  could  get  lost  - 
not  knowing  where  he  is  in  a  tree  or  how  to  get  to  the  particular  format  he  desires. 

This  was  prevented  on  EAP  by  making  all  information  available  with  no  more  than  two 
button  presses  and  essential  information  available  with  no  more  than  one  button  press. 

These  aims  gave  rise  to  the  development  of  the  principles  of  format  management, 
format  construction  and  colour  usage  as  described  ir.  the  subsequent  sections. 

3.1  FORMAT  MANAGEMENT 

As  one  of  the  prime  aims  of  the  display  moding  task  was  to  produce  a  manageable 
format  hierarchy,  a  system  was  developed  for  EAP  which  could  be  extended  to  also 
satisfactori  ly  accommodate  future  weapon  system  formats.  ^oir.o  of  the  methods  used  to 
manage  this  hierarchy  are  as  follows: 

Various  phases  of  flight  were  identified,  e.g.  Ground  Procedures,  Take  Off, 
Navigation,  during  which  the  pilot  requires  different  types  and  levels  of  information. 

The  pilot  has  the  facility  to  select  the  phase  of  flight  ho  desires  and  the  system  then 
presents  on  the  displays  that  information  he  needs  to  carry  out  that  phase  of  flight. 

Dedicated  push  buttons  are  provided  on  the  multi  function  displays  to  allow  direct 
selection  of  certain  important  formats. 

A  dedicated  push  button  is  available  (PRE),  on  each  mulu  function  display,  to  allow 
direct,  selection  of  the  format  that  was  presented  before  the  currently  displayed  one. 

A  dedicated  push  button  is  available  (NRM),  on  each  multi  function  display,  to 
return  to  the  format  that  is  normally  presented  on  that  display  for  the  particular  phase 
of  flight. 


A  dedicated  push  button  is  available,  on  the  stick  top,  to  directly  call  up  on  to 
the  head  down  displays  information  to  allow  the  pilot  to  recover  the  aircraft  attitude 
from  any  unusual  positions. 

A  soft  key  is  always  available ,  in  the  same  position  on  each  format,  to  allow  the 
pilot  to  step  through  all  the  formats  in  a  predefined  sequence. 

The  title  of  each  format  is  always  presented  in  the  bottom  right  corner  of  each 
format . 

3.2  FORMAT  CONSTRUCTION 

To  ensure  usable  displays,  rules  applying  to  the  detailed  design  of  the  formats  were 
determined.  The  following  are  some  examples: 

All  symbology  on  the  EAP  displays  is  drawn  cursively,  thus  providing  clear  symbols 
and  smooth  lines,  whatever  their  shape  or  orientation.  To  ensure  adequate  visibility 
the  minimum  character  height  was  defined  as  3.6  mm,  with  special  emphasis  being  provided 
by  characters  of  4.8  and  6  mm.  These  sizes  represent  17,  22  and  28  minutes  of  arc 
respectively  when  viewed  in  the  EAP  cockpit  and  provide  good  readability  in  the 
environment . 

To  ease  any  potential  problems  the  pilot  might  have  in  locating  information  on  the 
formats,  it  was  ensured  that  wherever  the  same  information  is  presented  on  a  different 
format  it  is  presented  in  the  same  position.  For  example,  whenever  heading  information 
is  presented,  either  head  up  or  head  down,  it  is  presented  at  the  top  of  the  format  in 
the  centre. 

-  On  the  EAP  the  control  inputs  are  either  initiated  manually  by  the  pilot,  using 
soft  keys  around  the  displays  or  on  the  manual  data  entry  facility,  or  automatically  by 
the  system.  To  ensure  that  the  pilot  is  always  aware  what  is  currently  selected,  a 
•sleeted  option  is  always  indicated  by  the  appropriate  legend  on  the  display  being  boxed. 

3 .3  COLOUR  PHILOSOPHY 

One  of  the  main  factors  which  distinguishes  the  EAP  from  other  military  aeroplanes 
is  the  full  colour  capability  of  the  three  head  down  displays.  An  extensive  colour 
philosophy  has  been  developed,  based  on  theoretical  and  experimental  concepts,  the 
principle  aim  of  which  is  to  use  colour  for  functional  rather  than  purely  aesthetic 
purposes.  This  does  not  in  any  way  mean  that  the  aesthetics  of  the  formats  were 
disregarded,  only  that  this  took  second  place  to  consideration  of  the  functional  use. 

To  meet  this  design  aim  the  majority  of  human  factors  research  recommends  a  limited  use 
of  colour  in  order  to  decrease  the  probability  of  habituation  and  hence  increase  the 
attention  getting  qualities  of  the  colour  when  it  is  present.  Starting  with  this,  the 
approach  taken  was  to  initially  consider  the  formats  as  achromatic  and  then  add  colour 
in  line  with  the  colour  usage  philosophy. 

It  was  considered  that  the  use  of  colour  on  the  displays  should  always  have  a  task 
related  meaning,  and  be  used  in  areas  to  maximise  its  effectiveness,  such  as: 

to  provide  realism,  e.g.  on  an  attitude  format  for  sky/ground. 

for  cueing  or  alerting  to  critical  features,  e.g.  high  priority  threats,  scales 
exceeding  limiting  values. 

whi.e  strong  associations  already  exist  with  a  colour,  e.g.  green,  red,  amber. 

for  relating  important  similar  information  on  a  cluttered  format. 

to  allow  a  distinction  between  symbols  on  scales  which  are  located  together. 

to  provide  contrast  between  a  sensor  video  picture  and  overlaid  symbology. 

N.B.  It  should  be  noted  that  while  the  benefits  of  colour  were  exploited  other  'coding' 
methods  were  also  continued,  such  as  shape  and  position  coding. 

Within  this  general  usage  philosophy,  specific  colours  were  used  as  follows: 

WHITE :  Basically  all  symbology  started  off  as  white  and  was  then  coloured  as 

necessary.  Two  whites  have  been  used,  a  Bright  White  and  a  Dull  White.  The  Bright  White 
is  the  most  visible  of  all  the  colours  under  all  ambient  illumination  conditions  and  lias 
been  used  for  all  changing  or  dynamic  symbology  and  alphanumer ics .  The  Dull  White,  while 
still  quite  visible,  does  not  appear  as  compelling  as  the  Bright  Whi*r»  and  tends  to  appear 
more  in  the  background.  This  has  made  it  a  most  suitable  colour  for  symbols  or 
a Iphanumer ics  that  are  fixed  values  and/or  do  not  change  their  position. 

GREEN ;  Green  has  been  used  where  a  positive  good  or  go  indication  is  required.  In 
addition  it  was  also  used  on  the  Horizontal  Situation  Display  (HSD)  as  a  trial  to  see  if 
the  format  would  benefit  by  linking  together  all  the  navigation  information  relating  to 
where  the  pilot  should  be  flying.  This  has  proved  to  be  very  useful  in  flight. 
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REP:  Red  has  been  used  only  when  related  to  red  warning  situations  or  threats.  In 
order  to  retain  the  impact  this  colour  can  have,  it  only  appears  when  the  'red'  situation 
is  reached,  e.g,  there  is  not  a  red  zone  permanently  shown  on  the  engine  temperature  scales 
indicating  overtemperature  -  they  turn  red  only  when  warranted  by  the  situation. 

AMBER :  Amber  has  been  used  only  when  related  to  amber  warning  situations  or  certain 
threats.  As  described  for  the  colour  Red,  Amber  only  appears  on  the  format  when  it  is 
required . 

BLUE:  Blue  was  shown  not  to  be  a  very  compelling  colour  -r.nd  was  basically  used  in 

two  ways.  It  was  used  as  an  infill  to  provide  realism  to  a  format,  for  example  to 
represent  the  sky  on  an  attitude  format  or  to  represent  the  fuel  in  the  format  showing 
the  aircraft  fuel  tanks.  Alternatively  it  was  found  that  Blue  could  be  quite  easily 
deliberately  ignored  when  looking  at  a  format  so  that  any  lines  drawn  in  blue  could  be 
seen  if  required  or  if  necessary  they  could  visually  fall  into  the  background  and  not  be 
noticed.  This  use  proved  convenient  for  drawing  demarcation  lines  on  a  format  or  even 
for  drawing  range  scales  which  could  be  quite  numerous  on  a  format  and  hence  potentially 
distracting . 

CYAN:  Cyan,  or  sky  blue,  is  the  only  colour  used  which  can  sometimes  be  confused 
with  other  colours,  i.e.  in  high  ambient  with  white  and  at  the  low  ambient  end  with 
green/blue.  However  it  proved  to  be  a  good  bright  and  visible  colour.  It  was  decided 
therefore  to  use  it  for  those  instances  where  the  actual  colour  used  was  not  important 
but  it  was  felt  the  information  concerned  would  benefit  by  being  a  different  colour  from 
the  information  around  it  to  allow  visual  discrimination . 

BROWN :  Brown  has  only  been  used  to  provide  realism  on  the  attitude  format  by 

representing  the  ground. 

In  practice  the  use  of  colour  on  the  MFD  has  proved  successful  on  EAP .  When  problems 
are  indicated  on  a  format  the  pilot  can  very  easily  and  rapidly  identify  the  area  of 
interest. 

The  principles  and  techniques  described  in  the  previous  sections  resulted  in  a  suite 
of  thirteen  formats.  The  next  section  outlines  a  selection  from  these  formats. 

3.  4  THE  FORMATS 

STATUS 


FIGURE  2  :  THE  STATUS  FORMAT 


The  Status  format  presents,  on  one  surface,  essential  information  on  the  health  of  the 
various  aircraft  systems,  to  save  the  pilot  the  task  of  paging  through  the  individual 
systems  formats.  An  important  use  of  this  format  is  on  the  ground,  during  aircraft  start 
up.  With  it  the  pilot  is  provided  with  much  of  the  information  that  he  requires  to 
initialise  the  aircraft  and  prepare  it  for  flight.  It  supplies  him  with  information  on  the 
state  of  various  systems  such  as  hydraulics,  fuel  and  the  engines  and  tells  him  if  these 
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systems  are  'GO'  and  therefore  ready  for  flight.  The  Status  format  also  provides  the 
pilot  with  the  facility  to  initiate,  if  required,  the  pre  flight  tests  on  various 
subsystems  such  as  Oxygen  or  the  TACAN  and  presents  the  results,  in  the  form  of  a  'GO'  or 
'NO  GO'.  Individual  test  selection  in  this  way  is  considered  acceptable  for  EAP,  however 
for  an  inservice  aircraft  it  will  be  desirable  to  initiate  all  such  tests  with  a  single 
key . 

In  addition  the  Status  format  is  used  as  the  hub  format  to  the  entire  format 
hierarchy  and  as  such  it  provides  direct  access  to  all  the  other  formats  with  one  button 
press . 

PRE  TAKE  OFF  MONITOR  ( PTOM ) 


FIGURE  3  :  PTOM  FORMAT 


While  the  Status  format  is  used  throughout  the  ground  procedures  the  PTOM  is  called 
up  just  before  take  off  as  a  last  check  that  the  aircraft  is  correctly  configured.  This 
format  acts  as  a  form  of  electronic  checker  that  tells  the  pilot  that  any  manual 
selections  under  his  control  have  been  appropriately  selected  for  take  off,  this  applies 
to  such  things  as  airbrakes,  canopy,  nosewheel  steering  etc.  Full  use  is  made  of  colour 
coding  on  this  format.  The  status  indications,  that  is  whether  the  canopy  is  locked  or 
unlocked,  the  nose  wheel  steering  is  engaged  or  disengaged  etc.,  are  written  in  green 
for  GO  or  red  infill  for  NO  GO  for  take  off.  The  pilot  then  basically  looks  to  the 
format  expecting  to  see  all  green  -  he  docs  not  actually  have  to  read  anything  -  and  if 
anything  is  highlighted  in  red  he  knows  that  one  of  the  pre  flight  actions  has  been 
forgotten.  Such  a  format  is  seen  as  essential  for  an  operational  single  seat  cockpit, 
where  the  pilot  does  not  have  a  second  crew  member  to  prompt  or  remind  him  of  necessary 
pre  flight  actions,  but  where  the  pilot  must  remember  for  himself  what  must  be  done. 


ENGINES 
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FIGURE  4  :  THE  ENGINES  FORMAT 


The  Engine  format  presents  digital  and  analogue  information  on  a  variety  of  engine 
parameters,  for  both  left  and  right  engines,  on  one  compact  format.  Engine  speed  and 
nozzle  area  have  been  combined  on  to  a  single  scale  as,  although  these  parameters  are 
unrelated  in  engine  terms,  to  the  pilot  they  indicate  the  thrust  level  of  the  engine. 

Some  engine  control  is  provided  by  the  soft  keys  and  those  controls  that  should  only  be 
used  on  the  ground  are  occulted  from  the  format,  and  the  function  deenergised,  in  the  air. 

HYDRAULICS 


(h  VALVE  OPEN 
VALVE  CLOSED 


FIGURE  5  :  THE  HYDRAULICS  FORMAT 
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The  Hydraulic  format  comprises  two  schematics  which  represent  the  left  and  right 
hydraulic  system.  Each  schematic  includes  scales  and  indicators  to  present  information 
on  pump  and  valve  positions,  pres.-ure  indications  etc.  Again  the  basic  presentation  of 
the  format  appears  green  and  whi*  when  the  systems  are  GO  and  areas  of  red  appear 
surrounding  indications  of  any  faulty  or  dangerous  situations.  As  with  the  engine  format, 
the  analogue  indications  are  supported  by  digital  values  or  word  captions  as  appropriate. 
Of  interest  on  this  format  is  the  way  the  digital  read  outs  move  alongside  their 
associated  arrowheads  on  the  analogue  scale.  This  serves  to  reinforce  the  position  of 
the  arrowhead  -  making  it  more  obvious  and  provides  the  digits  themselves  with  a  kind  of 
analogue  cue  by  their  position  along  the  scale.  Because  the  scales  are  all  relatively 
short  and  none  of  the  arrowheads  move  at  a  particularly  fast  rate,  there  are  no  problems 
with  locating  and  reading  the  digits. 

FUEL 


FIGURE  6  :  THE  FUEL  FORMAT 


This  format  represents,  in  pictorial  form,  the  layout  of  the  fuel  system  on  EAP. 

Soft  keys  also  provide  the  necessary  control  over  the  fuel  system.  The  tanks  are 
infilled  with  blue  and  the  level  of  this  infill  in  each  tank  descends  as  the  fuel  level 
decreases.  Pilots  have  felt  that  this  presentation  of  fuel  quantity  gives  a  good  clear 
picture,  at  glance,  of  how  much  fuel  there  is  in  total  on  the  aircraft.  Digital  readouts 
are  provided  of  the  exact  quantity  of  fuel  in  the  main  tank  groups.  Transfer  and  boost 
pump  states  are  indicated  in  the  appropriate  tanks. 


ATTITUDE  FORMAT 


FIGURE  7  :  THE  ATTITUDE  FORMAT 


The  Attitude  format  presents  similar  information  to  the  HUD,  in  a  head  down  situation. 
The  coloured  blue/brown  ball  mimics  a  conventional  attitude  instrument,  however  the 
presentation  here  is  deliberately  kept  similar  to  the  HUD  to  allow  very  easy  transfer 
between  the  two  displays,  as  this  is  an  electronic  display,  the  pitch  information  can  be 
sourced  to  present  either  attitude  or  climb  dive  information,  as  preferred  by  the  pilot. 

As  well  as  being  available  from  a  soft  key,  this  format  can  be  selected  via  a  stick  top 
control,  on  to  the  multi  function  display .  This  HOTAS  function  allows  the  pilot  to  immediately 
call  up  sufficient  information  to  recover  t.*e  aircraft,  to  straight  and  level  flight,  ihom 
any  unusual  attitudes. 

HORIZONTAL  SITUATION  DISPLAY  ( HSD) 


FIGURE  8  :  THE  HSD  FORMAT 
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The  HSD  provides  navigational  information  based  on  a  compass  rose  format.  As  well 
as  an  indication  of  own  heading  and  track,  direction  to  the  next  waypoint  and  TACAN 
beacon  are  provided  against  the  rose.  Each  of  these  symbols  have  been  carefully  drawn 
so  that  they  can  be  easily  distinguished  from  each  other  and  if  they  are  positioned  over 
each  other  they  can  still  be  individually  identified.  Own  aircraft  position  is  indicated 
at  the  centre  of  the  display  and  the  position  of  the  next  waypoint  in  the  route  is 
indicated  relative  to  that.  Additional  information  around  this  centre  compass  rose 
includes  at  the  top  some  details  on  own  aircraft,  on  the  left  details  on  the  selected 
TACAN  beacon  and  on  the  right  details  of  the  destination  waypoint  and  an  indication  of 
wind  speed  and  direction. 

4 .  HANDS  ON  THROTTLE  AND  STICK  (HOTAS) 

The  Hands  on  Throttle  and  Stick  (HOTAS)  concept  is  considered  to  be  fundamental  to 
the  cockpit  design  of  our  next  fighter  aircraft  and  as  such  has  been  catered  for  in  i he 
EAP  design.  Because  EAP  is  a  demonstrator  the  combat/sensor  related  controls  are  not 
active,  but  the  design  proceeded  in  this  way  mainly  as  an  exercise  to  gain  experience  in 
the  hardware  design  process  and  also  to  test,  in  the  air,  just  how  far  the  concept  can  be 
practically  and  usefully  extended.  Candidates  for  HOTAS  on  EAP  were  considered  to  be 
those  functions  which  the  pilot  needs  immediate  access  to  during  high  workload  and 
stressful  mission  phases,  such  as  combat,  and  those  functions  to  which  the  pilot 
frequently  requires  immediate  access. 

Results  of  mission  analysis  and  detailed  design  indicated  a  high  number  of  controls 
as  candidates  for  inclusion  on  the  HOTAS.  This  necessitated  a  particularly  good  design 
of  the  Throttle  and  Stick  tops,  which  could  physically  satisfy  the  full  percentile  range 
to  which  the  EAP  has  been  designed  and  which  also  could  allow  the  pilot  to  know,  without 
hesitation,  the  exact  position  of  the  control  he  requires  at  any  one  time.  This  design 
was  achieved  as  follows: 

A  good  basic  shape  was  first  derived  which  enabled  comfortable  positioning  of  the 
pilots'  hands  and  arms. 

Having  determined  the  required  functions,  they  were  allocated  to  which  was 
considered  to  be  the  most  appropriate  platform,  i.e.  throttle  or  stick.  In  general, 
weapons  related  controls  were  allocated  to  the  stick  and  the  sensor  related  controls  to 
the  throttles.  In  addition,  conventions,  where  they  existed,  were  respected,  e.g. 
airbrakes  to  throttles,  trim  to  stick  top. 

Functions  were  next  allocated  to  control  types,  e.g.  push  button,  toggle  action  etc. 
To  aid  in  absolute  identification  of  control  functions  different  'tactile'  tops  were  used 
for  many  of  the  controls.  This  was  considered  to  be  particularly  important  for  controls 
operated  by  the  thumb,  as  generally  a  finger  would  be  used  to  just  operate  one  control 
but  the  thumb,  being  more  dexterous,  was  allocated  with  several  controls  and  thus  their 
identification  could  be  aided  by  shape  coding.  A  basic  design  premise  at  this  stage, 
aimed  at  reducing  pilot  mental  workload,  was  that  there  should  be  no  multi  functioning 
of  HOTAS  controls  used  in  the  air. 

Controls  were  then  positioned  taking  into  account  how  accessible  a  function  should 
be,  how  frequently  it  would  be  used,  any  necessary  sequential  operation  with  other 
controls  and  allocating  the  control  to  the  digit  which  would  be  best  suited  to  its 
operation . 

This  entire  HOTAS  design  process  was  extremely  iterative,  starting  with  Plasticine 
models  in  a  static  cockpit  mock  up,  progressing  on  to  wooden  mock  ups  and  then  finally 
metal  models  in  an  active  cockpit  facility.  A  diagram  of  the  final  items,  showing  the 
distribution  of  controls,  is  figure  9. 


MANUAL  DATA  ENTRY 


It  is  now  well  accepted  that  the  single  seat  cockpit  creates  the  need  for  arranging 
the  data  entry  controls  for  the  various  aircraft  subsystems  (traditionally  scattered  on 
the  side  consoles  or  other  head  down  locations)  in  an  operationally  acceptable  manner  in 
a  centralised  and  relatively  head  up  location.  To  permit  this  on  EAP,  a  single  integrated 
keyboard  facility  was  developed  and  this  forms  the  left  hand  glareshield  area  of  the 
cockpit  (see  figure  10).  This  allows  easy  head  up  operation  by  the  pilot  -  providing  a 
good  steady  platform  fcr  the  arm  and  hand  under  vibration  conditions  and  yet  causing  no 
visual  obscuration  to  the  displays  during  operation  of  the  keyboard.  To  complement  this 
concept  the  right  glareshield  contains  dedicated  read  outs  associated  with  data  entered 
through  the  Manual  Data  Entry  Facility. 


The  type  of  data  to  be  manually  inserted  or  altered  on  the  MDE  on  an  operational 
aircraft  would  include: 

a)  Navigation  data:  waypoint  data  ( latitude/ longitude,  UTM,  Gcorof,  elevation,  time 
on  waypoint  etc.) 

b)  Navigation  aids:  TACAN  channel  and  mode 

c)  Navigation  modes:  route  planning  and  update 

d)  Communications:  radio  channel/frequency  selection,  modes  (e.g.  V/UHF ,  antenna 
selection,  bandwidth,  secure  speech  modes) 

e)  IN  alignment  modes 

f)  Time  (system  time,  GMT) 

g)  Engine  placard  data 

h)  Identification  system:  IFF/NIS  codes  and  modes 

i)  Defensive  Aids  Subsystem:  Chaff/flare  dispense  programmes,  modes  etc. 

j)  Armament  System  modes 

k)  Data  Link  (e.g.  JTIDS):  modes,  message  input  etc. 


1)  Landing  Aids:  MLS  channels  and  modes  etc. 


At  this  moment  only  items  a)  to  f)  are  implemented  on  the  E^P,  however,  as  with  the 
entire  cockpit  design,  the  hardware  and  moding  concept  could  encompass  the  remaining 
items  with  the  necessary  software. 

The  amount  of  data  to  be  controlled  by  the  facility  and  the  fact  that  the  hardware 
occupies  a  relatively  small  area  of  the  cockpit,  leads  to  the  requirement  for  many  of  the 
cohtrols  to  be  multi  function.  However  this  has  not  created  any  problems  with  tne  final 
design,  as  experience  has  shown  it  is  easy  to  learn  how  to  operate  the  unit  and  it  has 
proved  to  work  well  in  flight.  The  following  is  a  description  of  the  facility  which 
should  be  read  in  conjunction  with  figure  11. 


FIGURE  11  :  MDE  LAYOUT 


System  Selection  and  Moding  Keys  (SSMK)  (1):  Multi  functioning  of  these  keys  is 
allowed  by  the  fact  that  each  key  head  legend  comprises  two  rows  of  four  7x5  dot  matrix 
LED  symbols.  In  the  first  instance  these  keys  are  used  to  select  the  appropriate  system, 
e.g.  communicat ions .  When  the  required  system  has  been  selected,  the  legends  on  the  keys 
change  to  present  any  moding  options  that  are  available  for  that  system,  e.g.  for 
communications  this  could  include  bandwidth  selection.  Additionally,  at  tnis  time  these 
keys  also  allow  the  pilot  to  state  the  type  of  data  he  wishes  to  enter  (if  any  choices 
•xist),  e.g.  for  communications  he  has  the  choice  to  enter  either  a  manual  frequency  or 
alter  the  frequency  against  a  preset  channel.  Whenever  the  keys  are  configured  to  tnio 
moding  level  one  of  the  keys  is  always  reserved  as  a  reset  function  to  return  the  entire 
keyboard  back  to  allow  system  selection. 

Data  Entry  Keyboard  (DEK)  (2):  As  soon  as  a  system  has  been  selected  on  the  SSMK , 
the  DEK  is  configured  as  appropriate  to  input  the  necessary  a Iphunumerics .  Thus  with 
the  above  example  of  communications,  to  insert  a  radio  frequency  a  0  to  9  keyboard  will 
be  presented,  however  to  insert  a  waypoint  coordinate  in  UTM  the  appropriate  alpha  or 
numerical  keyboard  will  be  presented  as  squired. 

The  multif unctioning  of  this  keypad  is  made  possible  by  a  single  7x5  dot  matrix 
LED  symbol  within  each  keyhead. 

Read  Out  Lines  (ROL)  (3):  Once  a  system  has  been  selected  on  the  SSMK,  the  ROL  will 
reflect  the  data  that  is  currently  stored  within  the  aircraft  against  that  system. 

Therefore  with  the  Communications  system  key  selected  and  with  the  manual  frequency  moding 
key  selected,  the  ROL  will  display  the  manual  frequency  that  is  currently  stored  within 
the  radio.  As  the  pilot  then  changes  this  frequency  using  the  DEK,  this  new  frequency 
will  be  reflected  in  the  ROL. 

Each  of  the  two  ROL  comprise  twelve  7x5  dot  matrix  LED  symbols.  Underneath  each 
symbol  is  positioned  a  writing  marker  which  illuminates  as  appropriate  to  indicate  whet-.' 
the  next  character,  inserted  via  the  DEK,  will  appear. 

Writing  Marker  Toggle  Switch  (WMTS)  (4):  Under  normal  operation  the  writing  marker 
will  automat ica 1 ly  move  along  the  ROL  to  indicate  where  the  next  character  inserted  via 
the  DEK  will  appear,  however  tor  erioi  correction  purposes  the  WMTS  is  used  'o  manually 

move  the  writing  marker  to  position  it  below  the  character  the  pilot  wishes  to  alter. 

Movement  of  this  spring  loaded  toggle  switch  to  the  left  causes  the  writing  marker  to 

move  to  the  left  and  slice  versa  for  movement  to  the  right. 

Communicat ion  Channel  Selector  (CCS)  (5):  The  CCS  allows  selection  of  any  tudio 
channel  and  direct  selection  between  a  preset  or  manual  frequency  at  any  time,  irrespective 
of  current  SSMK  selections. 
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Waypoint  Indicators  (6):  The  Destination  Waypoint  (DWP)  window  indicates  the  waypoint 
which  the  aircraft  is  currently  flying  to  and  the  Set  WayPoint  (SWP)  window  indicates  the 
waypoint  which  follows  the  DWP  in  the  route.  During  waypoint  data  entry  the  SWP  window  is 
also  used  to  display  the  number  of  the  waypoint  on  which  the  pilot  is  currently  working. 

Change  Destination  (7):  This  push  button  is  used  to  enter  the  set  waypoint  as  t.he 
new  destination  waypoint.  This  control  can  be  operated  at  all  times  irrespective  of  what 
is  selected  on  the  SSMK. 

MDK  Memory  (8):  The  MDE  memory  provides  a  permanent  read  out  of  data  and  mod mg 
selections  hat  have  been  made  using  either  the  SSMK  or  the  DEK .  This  ensures  that 
regardless  or  what  is  selected  on  the  SSMK  at.  any  one  time,  the  pilot  can  always  be  suie, 
at  a  glance,  of  how  the  various  MDE  controlled  systems  are  tnodeu. 

Annexe  4  provides  an  example  of  now  the  MDE  can  be  used  to  input  a  manual  radio 
1'  requoncy . 

f>  .  I'H  E  W  A  k  N  L  NG  S  Y  ST  EM 

Ii  was  clear  from  the  beginning  of  t he  definition  phase  of  the  EAP  project  that  a 
basic  principle  in  an  advanced  aircraft  was  the  necessity  to  relieve  the  (single)  pilot 
from  the  burden  of  dealing  with  health  monitoring  of  on-board  equipments,  sub  systems 
and  systems.  in  addition,  in  order  in  limit  the  pilot  workload  following  an  on  board 
failure  or  external  hazardous  situation,  an  'intelligent'  warning  system  was  required. 
Following  these  basic  requirements,  a  health  monitoring  and  warning  philosophy  was 
developed  which  provided  under  normal  operating  conditions  automatic  health  monitoring 
r  (trough  equipment,  sub  system  and  system  continuous  or  interruptive  BIT  facilities. 

Adoption  of  this  philosophy  requires  that,  where  practical,  detection  and  diagnosis  of  a 
fault  and  correction  of  that  fault  automatically  takes  place  without  pilot  intervention, 
with  the  pilot  being  involved  at  the  diagnostic  and/or  corrective  stage  when  the  nature 
of  l he  feu  1 1  requ l res . 

Analysis  of  more  traditional  warning  systems  showed  <x  lack  of  consistency  in  handling 
end  presenting  warning  type  information.  Where  often  a  cockpit  might,  contain  a  central 
werr.jng  panel  and  attention  getting  (or  master  caution)  lights  for  the  majority  of 
warn  i  r.g  s ,  never  a  1  o»  her  warnings  would  st.  ill  have  their  own  unique-  indications  or  tones 
>.  t  :  >  -r  hups  a  retrofitted  'voice*. 

<>n  EA1  •  In.-  basic  philosophy  is  that,  the  warning  system  is  there  to  a  lor  t ,  inform  ir  1 
advise  *  he  pilot  (rather  than  staillo,  e^r.f  use  and  mislead!).  <  w  the  intent,  ion  that  aay 
allures',  procedural  or  systems  related,  snould  be  Handled  by  *  he  warning  system  and  t  ■>,. 
:.i-.a  hoi  a  of  odd  lights  or  tone  -  be  replaced  by  a  consistent  approach. 

Tno  first  ‘•top  in  developing  the  warning  philosophy  was  to  fief  me  the  different 
cat  !  goi  i  r-fc  of  warning,  as  follows: 

i  'a  ■  •  -go  r  \  I  :  is  a  proc-'d  .,  i  I  w.irn  •  r.q  mat  JS  nor  l  i  i  oa  t  l  on  to  t  a--  pilot  ol  a 

h  so.-.;,  virnat  ion  that  requires  i  nr..-*  d  1  i  •  •  ae*  ion,  •■..?.  missile  approacn  warning. 

v'at  •  -go.'  y  / :  :’hi:»  is  a  sys *  emu  warning  which  is  tr-nli*  ionally  known  as  a  rod  warning, 

it  i  :,o»  i  !  i -sit  ict  ti-  me  :  i  lot  oi  a  rtimaiy  jailur*  tii.it  immediate  action,  *  .  u . 

-v (i  (lie. 


•  I  • 


is  a  -e/sf*n--  v.a  r ::  i  whr-i  i  t  ran  i  •  i  ona  I  1  y  known  as  an  anr«e« 

r * i  a < *•  y  :•:•■(•: . 


•  'I'-i  y  4:  hii..  i  •  .nivu-"  er  ,  m  -  >:  ime  it::  * «✓  the  [  i  lot  of  a  nrocedur.il  nature,  .  a 

•  .  a 1  •  go  i  :  *e  *.  *  p.e  :  t  :*•  -  toi  Ir.vimi  n*.  dia  nav--  beer.  u?ili:-*««i: 


l which  -  ran  in-  pi  eSsed  *n 


i  i;,  to  i.i<-  tailor*,  d  •  c 


t  he  I  lie*  *  o  t  lie  •  xi:.t.g:c*  t>  S  a 


A  a  i  -  I  .  *  i  •  -1  1  •  r  « ‘i  ■  •  e.  .  ..*  i  '  -  ;  !  <» »  v  »  •  ;  i  1  *  *  a  .  1  the  exact  r.a  t  ate  id  the 

I  .it  i .  i  ’  *  r  i  •  i  •  ■  of  i  * .  j  •  • :  .  ,  w  •  i :  h  i : .  •  I : .  ,  w !  i  •  ■ :  •  *  :  e  a  e  •  i  r. ; ,  'inn*  is  or  i  *  l  e  a  1  - 

i  f  •  w  m-  •  .  i  •:  •  t  r  ■  •  t  i;rm  o !  i  c«  -mr.a  :ai  *  i?  the  }  i  i  *  <  t  ,  <  • .  g  . 

;  i  ill'  ”  ;  :  ■  :  '  h*  ■  m-a  i  •  *  i*  r  i  •  'a*  v«  ■  i  *•  sMt.-s  *  n«  p  t  obi  *>m,  •  - .  g  .  "  la*  f  t  Kydi  a  a  1  j  os 

la*  .  r  •  I ;  ;  r  -v*  !.*  -•>:  » v  .  .*-  ■  t  t  :,e  viire  ar.«i  regent  ;  il  ovt  lmv:  ol  t  he 
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pilot's  jumI  w'lumit'l  ,  in  i  ho  r<isi>  of  category  2  and  3  warnings  the  voice  is  only  used  t;o 
inform  the  pilot  oi  priniaty  warnings. 

-  Mult  t  Fund  i  on  Pi  splay 

-  A  was  mua  c.ipt  umi  is  presented  on  the  multi  function  display  format  to  visually 
inform  the  pilot  m  to  the  nature  ot  the  warning  situation.  Colour  (red  or  amber  as 
appropn.it  -.p  is  associated  with  these  captions  and  the  captions  are  positioned  to  indicate 
a  left,  i  1.1:11  or  neuttal  system.  The  background  to  the  caption  is  flashed  to  indicate  tin* 
most  recent  warning.  On  a  lull  weapon  system  aircraft,  where  display  space  is  at.  a 
premium,  tins  function  won Ui  be  tiansferred  to  a  separate  warning  panel. 

Pilot's  :<otere:u*e  cards 

-  Traditional  use  is  made  of  the  flight  reference  cards  to  provide  the  pilot  with 
advice  on  pruceduies  and  consequences  following  a  warning  situation.  it  is  envisaged 
that,  the  next  stag*.'  1  rom  this  is  to  make  similar  information  available  on  a  MFD. 

(3 e  t  - 1  -  Home  W arr.in g 

-  in  the  event  of  a  data  bus  failure  the  facilities  of  the  main  warding  system  are 
lost,  and  the  pilot  relies  or.  what  is  referred  to  as  the  Got  -L'- Homo  warning  system.  This 
presents  a  limited  number  et  high  priority  warnings  that  are  independent  of  the  data  bus. 
As  the*  MFD  are  lost  with  the  bus,  their  function,  in  terms  01  presenting  warnings 
informat  ion,  is  replaced  by  t  ne  Get  -p-Home  warning  panel. 

it  should  be  noted  that  oai  ly  f  ;  / 1  ng  of  F.Al  did  not  evaluate  this  full  warning 
system  -  tins  is  planned  for  the  n«-xt  phase. 

T«J  THK  FffTCkf. 

P  r  l  nc  1  ji  *..*  .•> ,  developed  through  simulation  and  pilot  involvement  and  nns,  sir. 

*  1  igh:  ‘weiv’e  mon  Us  ago,  been  1  J own  by  ion  Bn:  1  ;h  and  jtalian  :*i  lot  s  ana 
many  more  on  the  ground.  1 A  photograph  01  *  he  final  cockpit  1  Ann  r*  i  . 

Bu*  u  i.-.  it  boon  a  wor’nwhil**  ex; er  1  --net- .’ 

Jr.  th**  eyes  of  the  r  '.'.^‘3  most  d-'i  irue'ly.  The  entire  aircrai*  ,  including  •  he 
cockpit,  has  roceivi-ti  .1  favourable  critique  and  r:v  pilots  ceitair.lv  nav*.-  no  problem 
flying  it  -  m  the  three  months  from  the  first  flight  ,  fifty  two  1  1  1  gilts  w**re  con.pl-  •••■: 

;.y  sewn  diJferont  pilots  a  rut  t  h« .*  second  phase  of  flying  orougle  six*  y  i*»uv  1  1  igh» s  in 
just  sixty  eight  days!  And  i*.  seems  •  h.it  despite  r  he  change  m  r  ocnr.o logy  •  ua:  LAP 
represents  over  traditional  cockpits,  pilots  can  very  easily  ’ram  on  how  »o  operar*  i‘  - 
it  •  axes  jjst  three  days  lor  a  visiting  pilot,  to  master  the  entile  aiierafr,  me! cdirni 
•no  cockpit,  and  its  assoc  ia*  ou  proc*  *iur  *-s .  it  is  described  on  ;•*  m.g  s*  r  *  •  jn*  •  :  u- 

a  n a  on  j o y able  t  o  use . 

It  nas  also  proved  a  worthwhile  experience  from  a  cockpit  o  igru-is  point  of  vi--w. 
Tine’*.*  is  now  confidence  that  «  full  weapon  system  cockpit  along  th**  HA i  Lines  will  wors; 

-  has  been  shown  that  facilities  such  as  oar  a  •  •nt.-y,  warnings  and  utilities  nanaq**n»e::t. 
can  i>*-  designed  and  integrated  within  tin*  cockpit  in  suc:i  a  way  *na*  th*’,  n*.  <d  not  t  a*e 
prioiity  in  th**  pilots  span  01  attention  -  they  can  beoon-.e  background  and  root  me 
facilities  to  the  pilot,  so  that  he  may  concentrate  his  ei  fort  on  being  a  weapons  mana  t-  r. 

To  this  end  the  EAP  cockpit  has  formed  an  admirable  basis  101  work  on  tin*  but  op*  -in 
Fighter  Aircraft  (fcJFA).  An  important  aspect  01  tins  is  the  tact  that  within  tin.  design 
team  there  are  now  people  in  the  unique  position  of  just  having  designed  and  built  one 
aircraft  and  now  they  are  immediately  starting  on  the  next,  w .  t .  so.it  a  significant  time 
gap.  Indeed  the  benefits  of  KAP  will  continue,  as  new  concepts  a  re  evolved  on  i*  1  r. 
further  trials;  initially  this  will  involve  incorporation  ot  rh**  full  warning  system  and 
control  by  the  use  of  Direct  Voice  Input  IDVll.  Tims  it  is  hop*  d  "mat  building  or:  this 
very  recent  experience  with  the  DAP  we  shall  be  able  to  work  towards  t  (i-*  next  gen*  :a  t  i  or 
Ku  ru; a n  cue k p  1 1. . 
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A  totally  enclosed  cockpit  may  quickly  become  the  driving  factor  for  the  next  generation  of  tactical 
fighter  aircraft  and  will  deny  access  to  the  pilot  of  essential  outside  world  cues.  Furthermore,  the  number 
of  sensory  systems  carried  aboard  the  aircraft  is  increasing,  with  the  threat  of  unacceptable  pilot 
workload.  Pilot  and  aircraft  reaction  times  may  be  a  decisive  factor  in  any  conflict  situation  in  the 
future,  so  the  pilot  must  have  a  greater  situation  awareness  than  ever  before. 

The  future  cockpit  designer  must  have  a  greater  appreciation  and  awareness  of  the  human  factors  related 
Issues,  and  in  addition  tailor  system  performance  to  match  human  performance  limitations. 

This  paper  assesses  the  cockpit  situation  and  examines  how  the  pilot  can  be  successfully  integrated  with 
newly  emerging  technologies  to  overcome  the  problems  introduced  by  a  closed  cockpit  philosophy  and  Increased 
workload.  It  concludes  with  an  insight  into  one  possible  cockpit  solution. 

1.  INTRODUCTION 

Today's  conventional  cockpit  designs  do  not  provide  an  optimum  man-machine  interface  for  the  pilot,  due 
mainly  to  physical  constraints  in  the  positioning  of  displays  and  controls  in  the  cockpit.  Recent  advances 
In  technology  have  resulted  in  electro-mechanical  instrumentation  being  replaced  by  computer  generated 
graphic  displays,  either  mimicing  conventional  analogue  instrumentation  or  presenting  highly  processed 
information.  The  head-up  display  is  still  considered  to  be  the  primary  display  surface,  which  can  provide 
an  image  over  a  40  degree  x  30  degree  field  of  view.  Other  cockpit  displays  are  typically  high 
resolution,  colour,  cathode  ray  tubes.  These  colour  displays  are  mounted  In  a  head  down  situation  so  as 
not  to  compromise  out  of  the  cockpit  views,  whilst  providing  some  measure  of  protection  against  high  ambient 
lighting  effects.  The  positioning  of  these  displays  is  generally  governed  by  physical  installation 
constraints.  The  illustration  given  in  Figure  1  shows  the  advanced  cockpit  that  has  been  used  with  the 
Avionic  Systems  Demonstrator  Rig  ( ASDR)  at  British  Aerospace,  Brough.  Compromises  had  to  be  made  during  the 
design  of  the  cockpit  such  as  the  positioning  of  the  centre  head  level  display.  Installation  of  the  head  up 
display  at  the  correct  design  eye  position  forced  the  two  standby  instruments  to  he  sited  below  the  up-front 
control  panel  of  the  head  up  display.  Immediately  below  these  Instruments  is  the  head  level  display.  In 
essence  the  positioning  of  these  devices  was  governed  by  the  depth  of  the  standby  instruments  which  had  a 
behind  panel  depth  of  some  200  millimetres.  These  instruments  now  have  a  behind  panel  depth  of  about  20 
millimetres.  This  now  allows  them  to  he  fitted  in  place  of  the  up-front  control  panel,  thereby  raising  the 
head  level  display  to  it's  correct  position. 

The  future  fighter  pilot  will  be  expected  to  wear  bulky  protective  clothing  to  e 'able  him  to 
withstand  hostile  battle  field  threats.  The  resulting  combination  of  very  restrictive  head  gear  and  gloves 
means  that  the  pilot  Is  being  denied  access  to  his  machine.  (Refer  to  Figure  2)  A  fully  suited  pilot  can 
hardly  reach  more  than  25  percent  of  the  available  control  panel  area.  Add  to  this  the  effects  of  'g', 
(perhaps  caused  by  even  a  gentle  manoeuvre)  then  the  pilot  can  be  in  serious  trouble.  About  fifteen  years 
ago  the  advent  of  micro-processor  based  systems  was  seen  as  a  means  of  reducing  pilot  workload  through 
priority  and  scheduling  of  pilot  tasks.  Unfortunately,  pilot  workload  has  increased  due  to  a  more  capable 
enemy.  The  aggressor's  smart  weapons  will  demand  even  faster  reaction  times  from  the  pilot  and  his  defence 
systems.  Any  time  advantage,  that  the  pilot  can  gain  over  his  aggressor  will  be  a  decisive  factor  in  any 
hostile  engagement.  Aiming  weapons  through  a  relatively  narrow  field  of  view  head  up  display  will  require 
the  pilot  to  position  his  aircraft  so  that  the  target  is  within  the  field  of  view  of  the  head  up 
display.  A  definite  time  advantage  could  be  gained  if  the  pilot  could  designate  the  taiget  by  his  line  of 
sight  which  effectively  operates  over  a  wider  field  of  view.  This  will  mean  that  multiple  target  attacks 
could  be  performed  more  effectively. 

Any  reduction  in  pilot  mobility  will  tend  to  decrease  his  time  advantage,  and  so  make  him  more  reliant 
on  his  on-board  sensors  and  processing  systems.  Today's  technology  has  reached  the  point  where 
significant  computational  power  is  available.  The  over-riding  weakness  lies  with  on  board  sensors  and  their 
level  of  integration  with  the  avionics  system,  and  the  pilot's  ability  to  assimilate  the  amount  of 
available  data.  The  future  cockpit  designer  needs  to  consider  information  transfer  more  carefully  than 
ever  before,  because  this  area  will  be  the  'bottle-neck'  between  the  man  and  his  systems.  Understanding 
human  cognitive  processing  will  feature  highly  throughout  any  future  cockpit  design  process.  Designers 
will  have  to  Interface  the  pilot  very  closely  with  his  systems  to  ensure  an  effective  solution.  Whatever 
approach  is  taken  it  will  be  necessary  to  consider  the  effectiveness  of  the  interface  under  failu  e 
conditions,  in  other  words,  'How  will  the  system  operate  In  th^  event  of  system  failures,  and  will  the 
pilot  be  aLle  to  Cv...Linue  his  tasks  ?'  Unless  we  are  prpnpred  to  accept  fully  automated  attack  and  defence 
systems  then  the  cockpit  will  be  a  critical  source  of  mission  success.  The  pilot  will  remain  accountable  for 
the  actions  of  the  aircraft.  One  of  the  main  requirements  of  the  future  military  cockpit  is  the  need  to 
communicate  a  three  dimensional  spherical  awareness  to  the  pilot,  such  that  his  overall  situation  awareness 
is  not  compromised.  Existing  cockpit  displays  are  constrained  to  a  two  dimensional  presentation.  A  major 
difficulty  facing  the  designers  of  the  next  generation  of  advanced  cockpits  is  the  lack  of  understanding  or 
even  definition  of  situation  awareness.  Clearly  it  is  important  to  measure  how  well  the  future  cockpit 
design  Cv.  .uunlcates  overall  situation  awareness  to  the  pilot.  Without  this  metric  designers  will  not  be  able 
to  assess  the  benefits  of  Integrating  the  pilot  : a  a  particular  way. 


1.1  Current  Visual  Capability 

Tlie  normal  human  visual  field  is  shown  in  Figure  3  which  shows  the  position  of  binocular  vision. 
The  standard  MK4  flying  helmet  and  oxygen  mask  reduce  the  visual  field  to  that  approximately  given  in 
Figure  4.  It  should  be  noted  that  these  illustrations  are  for  a  static  head  position.  Any  attempt  to  move 

the  head  quickly  to  track  a  target  will  result  in  the  helmet  lagging  behind  head  position,  with  a 

consequential  reduction  in  the  visual  field.  The  standard  issue  Nuclear,  Biological  and  Chemical  (NBC) 
respirator  further  compounds  this  problem  because  it  allows  the  head  to  move  more  freely  within  the 
helmet.  Under  high  'g'  levels  the  pilot  will  be  unable  to  move  his  head.  Therefore,  any  compensatory 
movement  of  the  head  to  get  a  good  visual  field  will  be  impossible.  Tc  is  well  known  that  the  pilot's 
performance  is  severely  Impaired  with  a  reduced  peripheral  vision,  how  level  high  speed  flying  can  put  the 
pilot  and  aircraft  at  risk.  Even  the  wide  field  of  view  head  up  display  presenting  a  field  of  view  of  40 
degrees  In  azimuth  and  30  degrees  in  elevation  does  very  little  for  look  Into  turn.  Although  the  geometry  of 
the  aircraft  has  an  impact  on  the  pilot's  visual  capability  it  seems  that  the  pilot's  protective 
clothing  may  be  the  limiting  factor.  Many  pilots  have  been  overheard  saying  "In  combat  conditions  I  shall 
wear  my  old  MK1  leather  flying  helmet."  The  lesson  to  be  learnt  here  is  that  pilots  are  crying  out  for  an 
Increased  visual  capability.  The  pilot’s  dominant  sensing  system  Is  his  sight.  Therefore,  in  any  future 
cockpit  design  we  must  take  a  look  at  new  technologies  that  will  improve  the  visual  field.  The  closed 
cockpit  essentially  closes  down  the  outside  world  view,  and  the  pertinent  point  here,  is  the  visual  field 

capability  of  the  sensors  used  to  convey  the  outside  world  scene  to  the  pilot.  It  might  be  tempting  to 

present  a  monocular  scene  to  the  pilot,  but  what  will  the  loss  of  depth  perception  do  to  his  overall  flying 
and  weapon  aiming  capahiLlty?  The  problem  becomes  particular!/  acute  when  trying  to  la-!  a  vSlOl. 
aircraft  where  all  round  vision  and  depth  perception  becomes  particularly  important.  If  binocular  vision  is 
required  then  what  angular  separation  and  binocular  disparity  is  required  at  the  stereo  sensor  unit? 

1.2  Dual  Interface  Crists 

The  closed  cockpit  will  cause  sensory  deprivation  to  the  pilot.  Whilst  this  fs  a  serious  problem  another 
equally  serious  problem  is  due  to  the  pilot  being  deprived  of  movement .  This  immobility  or  ph/niial 
restraint  is  caused  by  restrictive  clothing  and  high  'g'  levels  which  makes  manual  tasks  such  as  switch 
selection  very  difficult.  Therefore,  the  cockpit  designer  is  faced  with  a  dual  interface  crisis:-  t lie 
visual  and  control  interfaces. 

The  remainder  of  this  paper  describes  a  route  through  this  'Huh!  Interface  Crisis'.  I r  will  provide 
the  future  cockpit  designer  with  an  .tnswer  to  his  interface  problem. 

However,  the  designer  should  take  particular  care  with  semi  and  fully  automated  systems  to  ensure  thev  are 
matched  to  the  capability  of  the  human  operator. 

1.3  Pilot  Interaction  with  Automated  Systems 

Automated  routine  pilot  f  motions  such  as  automatic  switch  checking  (during  the  start  up  of  an  c.i  rcraf  t), 
and  auto-pilot  functions,  could  he  described  as  essentially  low-bandwidth ,  and  generally  do  not  effect  the 
mission  survivability  of  the  aircraft. 

Other  automated  functions  such  as  threat  and  scenario  processing  arc  used  to  determine  it  tack  protiles  and 
egress  routes.  These  are  the  high  bandwidth  systems  since  the  pilot  would  nut  be  able  to  menially  prunes-, 
the  large  .mount  of  data,  and  the  mission  survivability  of  the  aircraft  will  most  •••rt  ai  nl  v  depend  i 
continual  and  rapid  assessment  of  the  tactical  scene.  It  is  these  latter  systems  where  pilot  interaction  i  •, 
Important.  There  is  little  point  in  providing  an  automated  system  with  fast  update  rate  if  the  pilot 
response  time,  due  to  data  .assimi lat ion,  is  very  low.  Kven  though  the  resulting  display  data  has  been  highlv 
processed  it  is  important  to  communicate  the  true  situation  awareness  as  rapidly  is  possible,  par-  ;  cu  !a  r  I  v 

if  the  pilot  has  to  react  to  the  situation  by  pressing  the  trigger  to  give  tin?  final  release  consent  to 

launch  his  weapons.  The  author  has  seen  examples  of  tactical  displays  where  two  display  surruces  must  he 
used  to  communicate  situation  awareness  to  the  pilot.  This  is  an  example  where  the-  man-machine  interface 
becomes  the  limiting  factor  because  the  tactical  situation  displays  present  the  battle  scene  as  a  series  of 
discrete  event  points.  As  time  proceeds  these  event  points  are  spatially  updat..  A.  in  <>rdcr  to  .  unrmnicate  an 
overall  situation  awareness.  Kven  a  moment's  distraction  will  require  i  significant  amount  >t  tine  t  > 
assimilate  the  data  again,  rt  's  important  there for*,  to  present  the  i nformat i on  in  an  intuitive  manner 

that  requires  very  little  time  to  continual  ly  re-assess  the  scene.  An  example  will  illustrate  t'**  concept . 

The  display  format  presented  in  Figure  5  shows  that  our  aircraft  is  under  threat  iron  two  hostile  aircraft, 

the  position  and  directions  of  which  are  shown  as  svnbols  A  and  B.  The  straight  vector  emanating  from  each 

target  serves  to  indicate  both  direction  and  relative  velocity  >f  the  target.  In  order  \  >■>  take  on  the  tw» 
targets  it  is  necessary  for  the  pilot  t<»  determine  which  target  presents  the  greatest  threat  and  destroy  it 
before  the  other  one.  It  is  presumed  a  tactical  decision  aid  is  providing  some  form  ot  automatic  threat 
assessment,  but  the  pilot  still  has  to  assimilate  the  display.  The  pilot  will  have  only  seconds  in  which  t.» 
react  to  these  changing  threat  conditions.  Therefore,  careful  thought  must  he  given  to  the  way  that  data 

is  presented  to  the  pilot.  One  possible  display  technique  Is  given  In  Figure  h  which  shows  the  same  three 

host  ties,  but  this  time  overlnyed  with  a  probability  ot  kill  contour  nap.  The  pilot  is  able  to  quickly 
determine  from  which  area  the  greatest  threat  occurs  and  where  pov.it  ions  of  advantage  can  he  found.  In  i 
similar  way  1 1  is  also  possible  to  display  probability  of  survival  as  shown  In  Figure  (The  reader  should 
note  that  for  purposes  of  reproduction,  the  dfsnlay  Is  shown  in  monochrome,  whilst  for  the  cockpit 
display,  full  colour  wilt  be  vised.)  Nevertheless,  it  Is  still  necessary  to  measure  tin?  level  of  situation 
awareness  that  these  displays  communicate  over  and  above  the  earllt.i  presentations.  Kven  though  we  do  not 
yet  have  defined  measures  of  situation  awareness,  perhaps  pilot  reaction  tines  are  one  of  the  key  parameters 
that  could  be  used  as  a  first  order  assessment. 


2.  PILOT  CONTROL 

2.1  Intuitive  Direct  Voice  Input 

Much  has  been  written  on  the  subject  of  voice  control.  Indeed,  there  are  many  excellent  systems  available 
off  the  shelf  which  can  achieve  a  high  recognition  rate.  Application  of  these  systems  to  the  military 
cockpit  has  been  slow  and  generally  r  nflned  to  research  vehicles.  The  restrained  pilot  will  have  to  rely 
more  on  the  spoken  command  In  order  to  Interact  with  his  systems.  Although  there  are  questions  relating  to 
the  use  of  voice  command  in  high  'g1  levels  and  high  stress  situations,  it  is  necessary  to  consider  whether 
or  not  the  pilot  could  use  the  system  to  his  advantage  in  less  arduous  situations. 

Most  modern  aircraft  employ  some  form  of  centralised  briefing  system  which  allows  the  piiot  to  enter  the 
aircraft  with  a  small  portable  data  store  containing  route  information,  tactical  data  and  weapon 
configurations.  This  data  store  is  used  to  brief  all  the  necessary  avionic  systems  and  relieve  the  pilot  of 
a  lengthy  and  tedious  numerical  input  task.  Furthermore,  each  navigation  point  may  require  as  many  as  ten  or 
more  separate  data  values  representing  latitude,  longitude,  overfly  height,  etc.  If  the  aircraft  is 
operating  from  a  dispersed  or  makeshift  airfield  without  access  to  a  briefing  ground  station,  then  the 
pilot  is  faced  with  a  daunting  task.  Voice  control  would  seem  to  be  a  reasonable  solution  to  deal  with  this 
unwieldy  mass  of  data. 

Any  reduction  in  control  panel  space  for  whatever  reason  will  require  an  alternative  means  of  inputting  the 
same  da La. 

F.arly  efforts  with  voice  input  have  been  directed  towards  high  recognition  rates  and  large  vocabularies.  A 
somewhat  contradictory  requirement  in  a  noisy  aircraft  environment.  A  spin-off  from  data  bus  orientated 
aircraft  is  the  large  data  base  that  is  potentially  available  on  board  Lhe  aircraft  and  which  could  be 
used  to  determine  the  context  of  the  aircraft.  This  context  will  typically  describe  aircraft  state,  flight 
phase  etc.,  all  of  which  could  be  used  as  a  filter  or  mask  for  a  speech  recogniser's  vocabulary. 
Contextual  decoding  in  "peech  recogniser  would  reduce  the  si/e  of  the  vocabulary  search,  and 
Increase  iecognl t ion  accuracy.  The  total  on-board  vocabulary  will  be  very  large  and  could  be  broken  down 
Into  sub-sets  according  to  context  requirements.  Studies  suggest  that  this  contextual  decoding  could  be 
performed  with  very  little  computational  overhead,  providing  the  whole  aircraft  system  is  driven  by  a 
series  of  Finite  State  Processsors.  (Finite  State  Processing  is  dealt  with  in  Section  4.2.) 

A  technique  requiring  fur:her  research  is  ’pre-emptive  prompting’.  Here  the  pilot  would  be  prompted  with 
key  words  appearing  on  the  read-out  line  on  his  display.  Thccc  key  v;^rds  would  be  those  most  appropriate 
for  the  action  currently  being  formated.  If  it  is  not  possible  to  devise  a  free  and  flexible  syntax 
structure,  then  'pre-emptive  prompting'  may  guide  the  pilot  through  the  correct  sequence.  It  still  has  to  be 
determined  whether  or  not  only  command  displays  are  to  be  permitted.  Nevertheless ,  in  the  test  equipment 
world,  demonstrations  of  'pre-emptive  prompting'  have  proved  to  be  a  very  effective  method  of  controlling  a 
complex  system.  Clearly,  the  technique  could  be  applied  to  both  direct  voice  input  and  menu  selections 
on  a  display  head. 


Employing  the  eye  as  a  switching  mechanism  has  been  proposed  for  some  tine  as  a  hiocyhernet ic  control 
approach  that  may  be  used  to  reduce  pilot  workload.  The  pilot  would  move  his  line  of  sight  to  a  control 
surface  in  order  to  select  weapons,  display  modes,  etc.  Eye  control  would  eliminate  the  need  for  selective 
manual  responses.  Eye  tracking  and  oculoraeter  systems  have  been  in  use  for  a  number  of  years  to  assist  in 
basic  workload  experiments  and  in  research  connected  with  producing  television  advertisraents.  Early  eye 
tracking  systems  were  bulky  and  required  a  fixed  head  position,  but  more  recently  systems  have  become 
smaller,  and  therefore  do  not  require  a  fixed  head  position,  making  them  more  suitable  for  consideration  as 
a  cockpit  system.  Research  reported  by  Calhorn  1986  has  shown  that  eye  switching  is  a  feasible  alternative 
to  manual  switching,  and  would  be  faster  than  a  voice  activated  system.  When  the  pilot  is  'head-out'  of  the 
cockpit  then  eye  switching  would  allow  certain  essential  control  tasks  to  bo  completed,  without  the  pilot 
having  to  direct  his  attention  inside  the  cockpit. 

Eye  tracking  systems  are  concerned  with  saccadic  eve  movements.  These  are  the  rapid  conjugate  movements  by 
which  we  change  fixation  from  one  point  Co  another  voluntarily,  and  include  the  lump  and  rest  fixation 
movements  observed  in  scanning  a  visual  scene.  They  are  characterised  hy  very  high  initial  accelerations  and 
a  final  deceleration  (40,000  degrees/sec/sec).  An  excellent  survey  of  eye  movement  recording  methods  is 
given  by  Young  1975  and  will  not  be  repeated  hero. 

To  make  use  of  eye  t  rac!-  *  g  systems  in  the  cockpit  it  will  he  necessary  to  be  able  to  track  eye  positions  of 
different  sized  pilot*  .  over  a  wide  variation  of  illumination  levels.  Obviously  if  the  closed  cockpit 
does  become  a  rejuir  it,  then  ambient  lighting  levels  could  be  carefully  controlled.  The  more  interesting 
challenge  comes  from  the  engineering  task  of  integrating  the  eye  tracker  optics  with  the  helmet  mounted 
display.  Both  systems  will  have  to  share  the  sane  optical  path  In  tin’  coni ines  of  a  standard  t  lying  helmet 
hut  must  not  unduly  Increase  the  weight  of  the  helmet. 

Urgent  research  is  required  in  this  area  to  understand  the  basic  human  factor':  issues.  An  equally  important 
activity  to  be  addressed  is  the  integration  of  an  eve  point  of  regard  sensor  with  helmet  mounted  displays. 
If  we  assume  chat  this  can  b.-  achieved,  then  we  must  consider  how  to  use  eye  .position  sensing  in  the 
cockpi t . 

l.J>  Logical .  JMi^slca  1  Con t ro l  Injjut 

Dedicated  controls  arranged  on  separate  panels,  (performing  funcM  .us  such  as  common i cat  i on 
management,  radar  modtng,  etc.)  have  made  the  existing  cockpit  fairly  rigid  with  regard  to  input 
protocol.  Experimental  aircraft,  with  speech  recognisers,  still  need  to  have  dedicated  back-up  controls  In 
the  event  of  speech  reengniser  fai  lure. 
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In  the  cockpit  of  the  future,  where  there  may  be  a  multiplicity  of  sources  of  control  Information  such  as 
voice  command,  eye  fixation,  and  tactile  and  aircraft  system  state,  we  need  some  means  of  managing  this 
Interface.  It  would  obviously  be  possible  to  connect  these  signals  together  in  parallel,  but  that  could 
lead  to  contention  in  the  event  of  failure  or  where  pilot  must  over-ride  any  automatic  selection. 
Fortunately,  if  we  look  to  the  computing  fraternity  there  is  a  ready  made  solution  that  has  been  designed 
to  manage  multiple  channel  access  to  a  finite  set  of  resources.  This  is  the  mapping  of  logical  or 
pseudo  devices  onto  physical  devices.  The  operating  system  assigns  pseudo  devices  to  the  user  and 
connects  them  to  physical  devices.  The  user  never  needs  to  worry  about  the  physical  devices,  Indeed 
the  physical  devices  may  change  according  to  resource  management.  Access  priorities  can  be 
established  easily  and  avoid  confLict.  Ic  is  a  simple  matter  to  apply  this  philosophy  to  the  cockpit  by 
assigning  the  various  input  systems  as  pseudo  channels,  and  allowing  a  cockpit  operating  system  to 
effectively  manage  the  resources.  The  operating  system  could  disable  inputs  in  the  event  of  failure, 
and  allow  backup  channels  to  gain  authority.  It  would  seem  appropriate  to  address  contextual  decoding  as 
a  means  of  filtering  on  the  control  input.  (Refer  to  Figure  I*.)  The  author  believes  that  the  Finite 
State  Processing  technique  as  described  in  Section  4.2  could  be  used  to  easily  implement  the  cockpit 
operating  system.  The  concept  of  pilot  intent  engine  has  been  indicated  by  Furness,  1986,  and  It  would  seem 
possible  to  run  this  system  in  parallel  with  the  cockpit  operating  system,  and  compare  pilot  action 
with  predicted  action.  This  would  provide  some  measure  of  pilot  cross  monitoring  with  perhaps  some 
form  of  visual  feedback  in  the  event  of  disagreement. 

2.4  Flight  Control  Inceptors 

Irrespective  of  the  type  of  technology  employed  for  the  cockpit  there  will  always  be  a  need  for  the  pilot 
to  manually  fly  the  aircraft.  Active  control  technology,  has  removed  the  direct  connection  between  the 
pilot  and  the  aircraft’s  control  surfaces,  to  ensure  that  the  aircraft  remains  within  Che  safe  part  of 
the  flight  envelope  whilst  auto-pilot  functions  reduce  the  amount  of  time  the  pilot  spends  correcting  his 
course. 

Thrust  demand  can  similarly  be  controlled,  and  Is  particularly  important  for  vertical  or  short  take  off 
aircraft.  Even  though  these  automated  systems  relieve  the  pilot  from  certain  tasks,  he  must  still  be 
able  to  input  demands  Into  the  system  and  be  able  to  achieve  control  in  the  event  of  failure.  The  VSTOL 
aircraft  presents  a  Fairly  difficult  task  for  the  pilot  to  fly  in  a  semi-automatic  or  manual  mode.  The 
pilot  has  to  manipulate  thrust  and  nozzle  control  to  maintain  the  fine  balance  in  the  transition  stage 
between  vertical  take  off  and  conventional  flight.  Combat  manoeuvrers  in  the  Harrier  using  nozzle  angle 
requires  manipulation  of  both  thrust  and  nozzle  levers  in  conjunction  with  pitch  or  roll  demands  on  the 
stick.  The  net  control  interface  is  rather  awkward  and  difficult  to  maintain.  An  integrated 
left-hand  Inceptor  with  an  advanced  flight  control  system  which  has  integrated  nozzle  angle  and  thrust 
demand  onto  one  assembly  will  be  required.  This  arrangement  will  result  in  a  'natural'  control  interface 
with  ample  room  for  the  Inclusion  of  several  HOTAS  controls  to  compliment  those  on  the  stick.  Figure  9 
illustrates  the  integrated  Left  hand  inceptor  that  lias  been  used  in  the  ASDR  Advanced  Cockpit. 

Flight  control  inceptor  transducers  are  particularly  vulnerable  to  the  effects  of  electro-magnetic  pulse 
(EMP)  and  lightning  strikes.  Transducers  used  to  sense  either  rotary  or  linear  position  currently  employ 
electronic  means  to  sense  posLtion.  Complete  screening  against  EMP  can  be  achieved,  but  the  associated 
wiring  remains  vulnerable.  It  is  conceivable  that  the  future  flight  control  computer  will  have  pure  optical 
Interfaces  with  the  outside  world.  All  the  sensitive  electronic  equipment  would  be  housed  in  tightly  screen 
enclosures. 

2.5  Optical  Switches 

An  optical  switch  system  has  been  proposed  (patents  applied  for)  and  makes  use  of  a  small  bar  code  or 
similar  code  etched  onto  the  moving  part  of  the  switch  mechanism.  As  the  switch  is  activated  the  bar  code 
modulates  the  light  beam  that  is  transmitted  over  the  fibre-optic  cable.  A  remote  bar  code  reader  will 
decipher  the  signal  before  Informing  the  appropriate  control  computer.  Error  correcting  and  checksum 
techniques  can  he  readily  applied  to  the  system  to  improve  the  integrity  of  the  overall  system.  A 
refinement  of  the  system  will  be  the  utilisation  of  an  optical  bus  that  would  be  used  to  connect  the 
Individual  switch  units  together  and  reduce  the  amount  of  Interconnecting  fibres.  A  single  fibre-optic,  cable 
and  bar  code  reader  wouLd  thus  serve  a  number  of  switches. 

The  resulting  switch  system  will  not  be  susceptible  to  electro-magnetic  interference  whilst  being  very 
'quiet'  in  operation  with  no  radio  frequency  emission. 

3,  PILOT  VISUALS 

3.1  Helmet  Mounted  Displays 

Conventional  head  up  displays  tend  to  have  a  practical  Limit  on  the  total  field  of  view  they  present.  This 
limit  tends  to  be  governed  by  the  size  of  the  combiner  or  holographic  elements  vised  to  relay  the  image 
into  the  pilot's  eyes.  The  maximum  value  Is  around  40  degrees  in  azimuth  and  30  degrees  in  elevation.  The 
other  disadvantage  Is  that  the  image  is  bore-sighted  to  the  aircraft  which  means  that  flight 
information  Is  constrained  tr>  only  a  small  part  of  the  total  411.  steriadian  field  of  view. 

The  helmet  mounted  display  presents  an  image  at  infinity  that  is  bore-sighted  to  head  1 Lne-of-s l ght .  The 
optical  combiner  is  positioned  much  closer  to  the  eye  than  a  conventional  head  up  dis, 'ay  which  results  in  a 
very  wide  field  of  view.  Either  monocular  or  binocular  displays  can  be  considered,  each  -«*ular.  presenting 
instantaneous  fields  of  view  of  about  80  degrees  in  azimuth  and  60  degrees  In  elevation,  uk  combined 
binocular  field  of  view  will  be  120  degrees  in  azimuth  by  60  degrees  in  elevation,  allowing  a  20  degree 
overlap  for  true  binocular  viewing,  with  the  total  field  of  view  being  limited  only  by  a  head  movement. 

The  attraction  of  a  very  wide  field  of  view  is  enormous,  but  helmet  weight  must  be  considered.  The  standard 
MK4  flying  helmet  is  just  abovjt  acceptable  under  conditions  of  high  'g'  but  any  increase  in  weight  caused 
by  adding  helmet  mounted  displays  is  clearly  going  to  be  a  problem.  If  we  consider  helmet  mounted  miniature 
colour  cathode  ray  tube  (CRT)  then  we  must  address  the  problem  of  practical  display  resolution.  The  display 


t rom  the  CRT  will  have  to  be  projected  onto  a  field  of  view  of  fid  decrees  by  7')  degrees  which  means  that  a 
very  high  resolution  will  he  required  f rom  the  CRT.  Current  full  colour  CRT’s  fall  short  of  tills 
requirement  because  of  phosphor  granularity,  spot  size  and  shadow  mask  spacing*  Limiting  the  colour  range 
to  just  a  tew  colours  will  mean  that  penetron  devices  could  be  used  which  will  eliminate  the  shadow  mask. 

Other  HMD  concepts  worthy  of  consideration  are  those  which  employ  remotely  mounted  CRT’s.  The*  image  is 
relayed  to  a  helmet  mounted  combiner,  via  a  coherent  fibre  optic  bundle,  refer  to  Figure  1".  Apart  from 
reducing  helmet  weight  it  is  possible  to  employ  a  larger  CRT,  thus  increasing  the  resolution.  The  larger  CRT 
would  certainly  be  able  to  produce  a  brighter  display  with  the  added  advantage  that  high  voltage  supplies 
would  be  off  the  helmet.  During  an  ejection  only  an  optical  interface  will  he  required  to  separate  thus 
avoiding  the  production  of  an  electrical  discharge.  Care  has  to  be  taken  with  the  design  of  the  helmet,  if  It 
is  to  he  fitted  with  a  miniature  CRT  device,  collimating  lenses  and  drive  electronics,  because  it  would  he 
easy  to  upset  the  centre  of  gravity  of  the  helmet.  This  would  then  affect  the  pilot's  head  movements  under 
*g’  loadings. 

Inspection  of  standard  Nuclear,  Biological  and  Chemical  protective  clothing,  wiiL  reveal  a  problem  with  the 
narrow  field  of  view  that  results  from  the  oxygen  respirator  assembly  (Refer  to  Figure  -a).  A  helmet 
offering  an  enclosed  environment  might  he  one  possible  solution.  The  helmet  visor  could  he  used  as  the 
display  combiner  and  will  be  made  with  holographic  elements.  (Figure  11.) 

3.2  Helmet  Position  Se nsors 

The  concept  of  the  helmet  position  sensor  is  straight-forward  and  several  devices  have  been  commercially 
available  for  many  years.  Sensing  techniques  either  employ  magnetic  field,  infra-red  beam  or  ultra-snnics  t  ■ 
resolve  head  position  with  six  degrees  of  freedom:-  azimuth,  elevation  and  roll  in  orientation  and  x,  •’  and 
z  in  position.  Each  sensing  technique  has  it's  own  merits,  but  the  magnetic  system  tends  to  be  more  accurate 
and  less  troublesome  in  operation.  The  primary  role  of  head  position  sensors  has  been  for  off  bore-sight 
weapon  aiming  with  simple  reticle  helmet  mounted  displays.  High  accuracy  and  fast  update  rates  were  never  a 
requirement  for  these  early  systems,  and  it  is  unfortunate  that  those  systems  never  gained  their  rightful 
place  in  the  cockpit.  This  may  be  attributed  to  the  simple  display  presentations  that  wore  possib’e  with  the 
technology  at  that  time. 

In  the  future,  helmet  position  systems  will  become  the  ma  ior  pilot  interface  with  the  avionic  system. 
Electronic  hybridisation  lias  led  t»>  very  small  cockpit  units  adding  verv  little  weight  to  the  helmet. 

In  considering  the  operational  requirements  of  the  helmet  position  sensor  it  is  necessary  to  understand  how 
the  head  position  dat^  is  being  used,  if  a  visually  coupled  system  is  proposed  then  attention  will  have  t*. 
be  given  to  the  accuracy  of  Lh"  sensed  head  position  and  the  response  time.  Any  '..«gs  in  the  system  will 
introduce  disorientation  effects  p  attitude  presentations. 

4.  DESIGN  METHODOLOGY  AND  TOOLS 

The  next  generation  of  cockpit  design  can  be  divided  into  two  main  phases  with  respect  to  the  design 
methodology  and  the  required  tools.  Firstly,  wo  have  the  methodology  and  tools  to  enable  the  designer  to 
realise  his  ideas  and  make  reasonable  estimates  to  the  likely  efficiency  of  the  nan-machine  interlace. 
Secondly,  we  have  the  manner  in  which  the  man  integrates  with  his  systems.  With  several  ways  ->!  interact  in.: 
with  his  systems  it  will  be  necessary  to  devise  an  interface  protocol.  It  is  also  tempting  to  close  the  loop 
betwe*  a  the  nan  and  his  systems  by  monitoring  certain  physiological  conditions  in  order  to  determine, 
pilot  state  of  consciousness  and  measure  of  workload.  Having  specified  a  series  of  measures  we  need 
to  consider  how  we  can  make  use  of  this  data  in  order  to  control  the  avionic  systems.  For  example,  ' g ’ 
induced  loss  of  consciousness  monitoring  or  perhaps  initiation  of  load  shedding  during  workload  saturation. 

4_.  1  __  Virtu a  l_  Ma:  .ikin  Design  Tool 

Ergonomic  based  design  tools  such  as  Micro-Saint  and  Sammy  are  available.  These  allow  simulations  or 
models  of  systems  to  be  built  and  analysed.  The  tools  allow  .«  certain  degree  ot  under  stand  f  ug  t  ■  b<- 
achieved  regarding  physical  man  but  lend  t  n  h«-  cumbersome  t<>  use. 


Traditional  cockpit  layout  tends  to  relv  upon  the  nani  pul.it  ion  .>•  <  two  dimension  1 1 

a  suitably  scaled  drawing  of  the  cockpit.  The  manikin  lias  been  designed  s.>  th  it  it  can 
sized  pilots  and  employs  suitable  linkages  to  restrict  limb  mo  venom!  t-.  Lint 
man i k i ns  are  used  to  visualise  reach  distances  etc.,  before  the  drawing  is  committed 
for  fabrication  of  a  wooden  space  model.  However,  the  majority  of  other  aircraft  d«.*s  i 
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by  computers  with  particular  emphasis  on  computer  aided  design  via  graph: 
be.-n  made  to  represent  or  model  h-inan  dynamics  in  a  computer,  bit  at 
manikin  structures  and  make  limited  use  of  graphics.  British  Aerospace  are 
three  dimensional  representation  of  a  manikin.  It  will  be  possible  to 
d  i  Tens  i  on.i  I  representation  of  the  cockpit  structure.  The  advantages  of  this  svsien  arc  <■ 
•at:  quickly  change  the  size  of  the  manikin  and  determine  whether  or  not  his  design  will 
and  positions.  It  is  envisaged  that  the  output  from  standard  models,  such  as  Micro-Saint 
inpot  Into  the  virtual  manikin  package  in  the  future.  One  significant  advantage  .*  i  t.  h 
ah.  .it.  to  i  e-pus  i  t  ion  tin*  designer’s  view-point  ffoiu  the  side  of  the  manikin  to  inside 
in  I  visualise  th,*  cockpit  in  would  he  seen  by  the  pilot.  Tin*  model  will  eventually  be  r  ■ 
t  hr*  field  of  view  restriction  imposed  by  helmet  and  night  vision  goggles,  et  .  .  The  user 
articulate  the  manikin’s  head  and  observe  the  effect  on  the  pilot’s  view  of  tin 
manikin  is  seen  as  an  important  step  in  cockpit  layout  techniques.  By  instrumenting  a 
possible  to  record  limb  positions,  and  replay  this  through  the  virtual  manikin  in  slow 
in  detail  the  man— machine  interface.  Tin*  whole  package  con  id  he  hosted  on  a  small  desk 
wide-spread  use.  By  simple  refinements  it  wi 1 1  he  possible  to  develop  the  program  int 
design  tool. 
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4.2  Finite  State  Procesalni 


The  finite  state  processor  (FSP)  is  a  mechanism  for  defining  system  state  changes  that  resu.c  from 
externally  or  Internally  generated  events.  These  events  could  be  pilot  Inputs  or  outputs  from  v  rious 
avionic  sub-systeras.  The  technique  Is  potentially  the  most  powerful  method  of  specifying  and  iroplen  nting 
complex  system  Interaction.  These  techniques  have  been  used  extensively  on  the  Ministry  of  Defence  A/iontc 
Systems  Demonstrator  Rig  with  significant  savings  In  the  production  of  software.  A  spin-off  f roc.  the 
technique  is  an  unambiguous,  yet  highly  visible  system  specification  that  can  he  used  by  the  system's 
integrator  or  equipment  sub-contractor. 

The  SP  is  based  on  a  series  of  finite  state  tables  that  describe  a  system  via  a  series  of  cells,  which 
define  a  sequence  of  actions  to  a  given  input  signal  according  to  system  state.  A  complete  system  may 
be  represented  by  a  large  finite  state  table,  or  a  number  of  smaller  finite  sLate  tables  some  generating 
signals  for  other  tables. 

The  finite  state  table  comprises  a  series  of  cells  which  define  a  series  of  actions.  TTie  various  states  are 
listed  in  rows  and  the  signals  are  listed  in  columns.  Each  cell  representing  a  valid  state  contains  two 
entries.  In  the  upper  left  corner  is  the  state  that  will  be  entered  when  the  given  signal  is  generated,  and 
in  the  lower  right  hand  corner  is  a  pointer  to  the  action  requiring  to  be  performed  prior  to  the  state 
change.  For  cases  where  a  state  change  needs  to  occur  without  a  corresponding  action,  then  the  lower  right 
part  of  the  cell  remains  blank.  If  the  system  is  in  a  st  .te  where  a  particular  signal  may  occur  but  the 
system  must  not  act  upon  it,  then  both  halves  of  .ie  cell  must  remain  blank  but  separated  by  a  diagonal 
line  Undefined  states  remain  blank  but  separated  by  a  diagonal  line.  Undefined  states  remain  blank,  and 
should  never  be  entered.  The  best  way  of  explaining  the  technique  is  by  way  of  an  example.  Figure  12  shows 
a  typical  communication  system  control  panel.  The  finite  state  table  used  In  the  communication  sub-system 
is  shown  in  Figures  13  and  14.  In  the  example  the  FSP  state  'SYSTEM  OFF1  represents  the  powered  down  state 
of  the  system.  Whilst  In  this  state  the  only  valid  signal  is  'POWER  APPLIED'  which  initiates  a  change  of 
state  to  POWERED  UP  and  causes  Action  17  to  be  performed.  Action  17  in  this  case  Initiates  a  procedure  which 
checks  whether  the  active  transmitter  Is  on  HF  or  on  V/UHF.  State  2  Ls  then  entered.  If  the  active 
transmitter  is  on  HF  then  Action  1  is  performed  and  then  State  3  is  entered.  Action  1  causes  a  state 
response  to  be  sent  to  the  avionics  bus  controller.  State  3  Is  the  selection  of  the  HF  T/P.  active  but  not 
transmitting.  If  the  Press  To  Talk  (PTT)  switch  is  pressed  then  Action  3  is  performed  which  causes  the 
transmitter  to  start  transmitting  before  moving  to  State  8. 

The  operation  of  the  FSP  relies  on  discrete  event  signals  initiating  state  changes  within  the  FSP  table.  In 
some  cases  It  may  be  necessary  to  delay  or  inhibit  the  generation  of  signals  that  normally  act  directly  on 
the  FSP  while  the  system  Is  in  certain  states.  This  is  achieved  by  means  of  the  procedure  or  process. 

Procedure:  A  procedure  can  be  defined  as  a  series  of  Instructions  that  are  executed  whenever  the  procedure 
is  called.  Procedures  are  under  normal  circumstances,  self  terminating  and  can  only  be  called  from  within  an 
action,  another  procedure  or  a  process. 

Process:  A  process  can  be  defined  as  a  procedure  which  upon  Initiation  from  within  an  action  will 
automatically  execute  at  a  defined  rate  until  It  is  halted,  either  from  within  a  subsequent  action  or  by  the 
process  Itself . 

Although  the  concept  of  the  FSP  seems  fairly  stralght'-f orward  the  real  benefits  come  from  the  fact  that  a 
series  of  software  tools  have  been  developed  to  take  the  FSPs  directly  into  high  level  code.  The  engineer 
can  design  the  FSPs  using  a  graphics  work  station  during  an  interactive  session,  and  generate  the  high  level 
code  via  an  automatic  program  generator.  Modifications  or  additions  can  he  made  quite  simply.  The  whole 
process  being  essentially  self  documenting.  Other  tools  are  being  developed  that  will  allow  complete 
standalone  testing  of  the  newly  created  FSP  prior  to  generating  the  code. 

By  representing  an  avionic  system  with  ’'SPs  we  can  build  a  completely  deterministic  representat Ion  of  ill 
the  states  that  the  system  can  enter.  The  author  has  applied  a  variation  of  this  technique  to  specify  an;1, 
control  the  display  modlng  of  a  single  seat  fighter  aircraft,  Kalawsky  '983. 

5.  VIRTUAL  CREW  WORK  STATIONS 


Cockpit  designs,  as  we  known  them  today,  will  have  to  change  radically  if  we  are  to  retain  an  advantage 
over  an  aggressor.  We  cannot  be  too  sure  whether  the  battle  will  bt  fought  with  stand-off  missiles, 
such  that  the  pilot  never  sees  the  other  aircraft,  or,  whether  the  pilot  will  bo  engaged  in  air  to  air 
combat.  But  we  can  be  sure  that  the  battle  field  will  he  very  hostile  and  fast  reaction  times  will  have  a 
marked  effect  op  the  outcome  of  the  battle. 

Installation  constraints  will  continue  to  impose  restrictions  on  the  man-machine  interface.  Therefore, 
any  solution  which  overcomes  these  limitations  will  Increase  mission  success  The  virtual  cockpit 
which  will  now  be  described  is  such  a  solution,  and  could  he  arh'eved  with  today’s  technology, 

A  virtual  ere  work  station  is  a  visual  presentation  of  a  control  panel,  and  perhaps  an  outside  world 
scene,  that  i.„  projected  for  the  operator.  The  display  ls  generated  hy  a  computer  graphic  machine  and 
could  be  projected  onto  a  reflective  surface,  or  presented  to  the  eye  via  an  optical  combiner  and  a  series 
of  lenses.  The  system  provLdes  a  visual  yet  virtual  representation  of  a  real  control  area. 

Helmet  mounted  displays  and  sighting  systems  to  date  are  only  target  designation  systems  to  allow 
off-bore  sight  weapon  aiming,  with  perhaps  slaving  of  an  off-bore  slight  sensor.  The  initial  role  ot 
the  helmet  mounted  display  was  to  generate  head  stabilised  weapon  aiming  cues  perhaps  supported  by 
additional  attack  symbology. 

The  concept  of  a  visually  coupled  system  has  been  published  as  early  as  1980.  The  visually  coupled 
system  Ls  a  display  system  that  is  Integrated  with  a  head  position  sensor  so  that  as  head  position  is 
varied  a  new  helmet  mounted  display  Image  Is  computed,  thus  allowing  the  possibility  of  space  tubilised 
Imagery  to  F  •  presented  to  the  pilot. 


Realisation  of  the  virtual  c  row  work  station  has  to  date  been  hindered  by  the  level  of  technology  required 
to  support  the  system.  Only  recently  has  the  technology  been  available  to  sense  head  position  sufficiently 
accurately,  in  conjunction  with  advanced  real-time  graphic  systems,  to  produce  the  required  presentur  *  ons . 
For  airborne  applications,  size  and  weight  are  of  particular  importance. 

The  concept  of  a  virtual  work  station  Is  extremely  straight-forward*  The  operator  is  presented  with 
a  computer  generated  representation  of  his  control  area,  such  as  a  control  panel  complete  with  switches  and 
displays.  As  the  operator  moves  his  head  the  display  will  remain  space  stabilised  so  that  the  control  panel 

will  move  out  of  the  operator's  field  of  view  as  he  turns  his  head.  Clearly,  this  assumes  that  head 

position  is  used  to  compute  the  new  display  view-point.  It  a  helmet  mounted  display  is  utilised, 

then  it  is  conceivable  that  a  full  160  degree  Total  Field  of  View  (TFOV)  could  be  presented.  Th*- 

L ns tantaneous  Field  of  View  (IFOV)  would  he  limited  to  chat  of  norma!  human  vision.  The  operator  could 
move  his  IFOV  port  hole  around  the  TFOV,  and  head  position  would  bo  used  to  compute  the  required  display 
presentation.  In  a  military  >  ockpit  this  offers  the  possibility  of  being  able  to  'see  through'  the  floor 
or  other  cockpit  structures,  providing  that  suitable  sensors  have  been  incorporated. 

The  visually  coupled  system  requires  head  pointing  data  with  six  degrees  of  freedom:-  azimuth,  elevation 
and  roll  in  orientation  and  x,  y  and  z  in  position.  The  head  pointing  data  is  then  used  by  the  graphic 
system  to  compute  a  correctly  orientated  virtual  display. 

It  is  necessary  to  present  data  as:- 

a)  head  stabilised  head  aiming 

b)  cockpit  stabilised  virtual  control  panels 

e)  ground  stabilised  target  locations  and  way-  points  (ground  referenced  objects) 

d)  space  stabilised  flight  information 

*>.l  Virtual  Worl d  Interaction 

The  operator  ,or  pilot,  will  require  some  means  of  interacting  with  his  virtual  world.  Obvious  solutions 
include  -  direct  voice  input,  head  position  sensing,  fixed  eye  sight.  Eye  fixation  could  be  used  to 
advantage,  but  this  implies  that  an  unobtrusive  eye  tracker  is  used.  Under  high  ’g’  conditions  as  might  be 
experienced  In  a  fighter  aircraft,  eye  tracking  systems  may  become  the  most  effective  means  of  interacting 
with  tiie  aircraft  system. 

It  is  likely  that  some,  if  not  all,  of  the  above  interaction  mechanisms  wilL  be  used  in  the  next  generation 
cockpits.  One  question  raised  at  this  point  is  -  'Which  selection  method  is  best  and  could  it  be  better 
achieved  via  a  different  method  at  a  different  point  in  the  task?’  Until  more  human  factor's  research  is 
undertaken  we  can  only  guess  at  the  answer,  but  we  can  be  fairly  sure  that  the  human  operator  may  be  more 
effective  if  numerous  access  channels  arc  open  to  serve  the  cask.  From  a  system  view  point  how  does  the 
designer  cope  with  all  the  possible  access  channels?  For  instance,  the  pilot  aids  aboard  the  aircraft  mav 
require  to  autonomously  select  a  particular  function.  The  pilot  may  need  to  over-ride  one  of  these  events 
but  how  will  this  be  achieved?  locally,  whichever  approach  is  decided  upon  it  is  essential  that  some  form 
of  selection  validation  is  performed,  perhaps  by  some  element  of  context  decoding. 

A  requirement  for  a  cockpit  operating  system  or  Executive  Function  is  emerging  to  provide  a  flexible  and 
yet  intuitive  interface  to  the  aircraft  system.  British  Aerospace  engineers  have  developed  a  technique  on 
the  Avionics  System  Demonstrator  Rig  based  on  a  finite  state.  The  approach  has  been  so  successful  it  has 
been  applied  to  the  specification  of  all  sub-systems  in  a  form  that  can  be  unambi gous 1 v  used  by  the 
individual  sub-system  manufacturers  lo  the  systems  integrator.  Software  tools  have  been  specifically 
developed  which  will  take  eng i nee r i ng  descriptions  of  system  operation  into  executable  code.  If  •"if  ! 
these  automatic  program  generation  techniques  could  significantly  redu.  e  the  cost  and  nan  years  of  software 
effort  for  the  nexi.  generation  aircraft.  A  further  advantage  lies  with  the  addition  of  new  features  .  >r 
"•e*M  f  i  rut  ions  in  the  future.  Her-’  it  is  a  simple  matter  to  incorporate  modifications  at  a  hip,!;  level,  rid 
the  low  levei  code  produced  awLomal  i  «-,i  i  ly .  T5.»  whale  ..roo.  s..  is  esyen*-  ‘  a  P  v  self  documenting,  thereby 
reducing  costs  further.  Code  can  be  produced  for  any  machine  with  a  suitable  target  generator  nod-uie. 
Additional  software  tools  ire  being  developed  allowing  the  complete  svstem  to  he  tested  and  vilidated  prior 
io  release.  Future  refinements  could  Lnclule  the  ahility  to  dynamically  alter  t he  contents  of  the  finite 
state  tables  giving  the  system  a  learning  capability.  The  •■oncept  of  a  knowledge  base  with  a  learning 
capability  could  be  an  important  feature  lor  future  avionic  systems  making  the  overall  avionic  svstem  more 
fault  tolerant. 

6.  ADVANCE!)  COCKPIT  CONCEPT 


British  Aer.ispoee  are  involve!  in  .level. -.ping  virtual  work  >.t  it  io«m  that  .  in  1.  '.polled  t 
work  station  requiring  human  irq.r.n  ti-.i-.  Tin-  w-uk  station  will  be  based  on  a  modular  .  r“w  -r  it 
panoramic  visual  and  auditory  displays.  Tin-  major  concept  rev-. Ives  around  a  virtual  crew  m  t 
Information  (  run  aircraft  sensors,  nav  i  gat  i  ,  .  mmuni  at  i  on  uul  we„p.m  systems  Is  ,rfi  ,n  i  sed 
to  the  pilot  in  three  dimensional  space.  The  virloa!  ti-v  station  :s  perhaps  the  most  i ;  f  up  • 
applied  to  voexpit  design  since  the  advent  •<-  the  mi ••  ro-proeessor • 

Boff,  1 points  out  chat  the  design  of  an  aircraft.  system  Involves  balancing  trade-efts  .among  nanv 
sub-system  priorities  to  achieve  a  required  functionality  within  material,  cost  and  timescale  constraints. 
The  interdependence  among  the  large  number  of  variables  that  contribute  to  the  overall  design  nuke  ir 
difficult  to  predict  the  influence  o!  my  -me  variable.  The  most  popular  slogan  used  at  present  i 
'situation  awareness*  which  does  seen  to  he  the  most  appropriate  metric  to  use  to  determine  system 
effectiveness  from  a  man-machine  interface  view-point.  'Inf orlunatel v ,  no  single  ->r  Series  of  measurement's 
can  be  defined  that  precisely  Jetine  'situation  awareness'.  It  is  known  that  situation  awareness  has  a 
bearing  on  pilot  reaction  time  and  perhaps  this  could,  be  used.  However,  it  is  likelv  that  other  parameters 


will  have  to  be  measured  to  provide  a  precise  measure  of  situation  awareness. 

A  basic  system  architecture  Is  shown  In  Figure  15. 

7.  CONCLUDING  REMARKS 

This  paper  has  alluded  to  the  dilemma  facing  cockpit  designers  of  future  aircraft.  An  enclosed  cockpit  along 
with  protective  clothing  will  limit  the  pilots  ability  to  inter.ici  with  his  systems  and  maintain  an 
awareness  of  the  outside  world.  Recent  advances  in  technology  have  been  discussed  with  a  view  to  identifying 
candidate  technologies  that  could  solve  many  of  the  cockpit  designers  problems.  There  is  no  doubt  that  the 
next  generation  of  cockpit  will  have  to  be  based  on  a  considerable  amount  of  human  factors  research.  One  of 
the  most  critical  areas  of  research  is  the  definition  and  measurement  of  situation  awareness  so  that  it  can 
be  used  in  the  design  process.  A  series  of  new  design  tools  will  also  be  required  to  deal  with  the 

integration  of  cockpit  systems,  especially  where  more  automation  is  demanded. 

The  techniques  of  Finite  State  Processing  have  been  described  with  particular  reference  to  an  existing 
system.  The  applicability  to  contextual  decoding  has  been  described  but  one  potential  application  for  future 
avionics  is  the  concept  of  a  FSP  system  that  can  leai  .  British  Aerospace  engineers  have  conceived  the  idea 
of  a  large  FSP  or  series  of  interconnecting  FSPs  that  can  update  their  own  cells  to  provide  a  self  teaching 
capability.  Little  can  be  said  at  this  stage  except  to  say  that  the  techniques  and  tools  developed  to  date 
lend  themselves  to  this  application.  Application  to  fault  tolerant  or  self  repairing  systems  is  obvious. 

The  most  significant  concept  to  emerge  in  the  cockpit  world  is  the  virtual  work  station  that  can  be  software 
re-configured.  Since  the  virtual  crew  work  station  is  based  on  a  visually  coupled  system  the  cockpit 
designer  is  no  longer  faced  with  an  inflexible  physical  structure.  The  designer  wil<  be  able  to  ma'*'  ®  the 
pilot's  visual  capability  in  a  way  that  has  never  been  possible  before.  The  pilot  -/ill  be  able  to  interact 
intuitively  with  his  systems  Ir.  a  natural  manner. 

Although  this  paper  has  dealt  with  a  singLe  crew  station  the  virtual  work  station  could  he  applied  to  any 

work  station  in  the  future  where  a  human  operator  has  to  interact  with  a  machine.  The  visually  coupled 

virtual  work  station  will  completely  revolutionise  the  man  machine  interface  as  we  know  it  today. 
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Figure  1  Mk  5  Advanced  Cockpit 


a)  Front  View  of  AR5 


b>  Side  View  of  Protective  Helmet  worn  over  AR5 


Figure  2  Aircrew  Protective  Head  Gear  (NBC  Hook  and  Mk  4  Helmet) 


Normal  Human  Visual  Field 
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Figure  6  Threat  Assessment  -  Probability  of  Kill 

Good  Situation  Assessment 


Figure  7  Threat  Assessment  -  Probability  of  Survival 

Good  Situation  Assessment 
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Figure  11  Holographic  Helmet  System 


Figure  12  Communication  System  Control  Panel 
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Figure  13  FSP  for  Communication  System  (simplified) 
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EBSOUW1CM  Cf  STATES 

$ySTQi  OFF  ;  1his  s'  t'x  • a  oi'et'ii  when  the  Turns  ctyston  is  no  longer  opera*  >onal 

sWrOI  OJ  This  is  a  'ransitei'  au'.e  which  is  accessed  while  .whet  siquU  aie  being 

HF  T-R  ACTIVE  MOT  TX'ING  :  This  state  la  entered  when  the  iff'  T'P  ib  nominated  active  on  tranain*.  but  is 
no*.  uansniiUnq 

1IF  T/R  AL.TIVE  TX"  IMG  :  This  state  is  entered  when  *he  IF  T/B  is  lumnai^il  ao  iv»  OTi  '-ranspn  ' .  hut  >s 

required  to  nansni  t 

V/UHF  T/B  ACTIVE  iOT  TX’IIC  :  Ihis  state  is  entered  when  -he  VAJHF  T/B  is  wwratert  active  cri  nanami'  and 
i  s  not  » i  iv*i  1 1  inq 

V/18F  T/R  ACTIVE  TX'IJC  :  This  state  oe  entered  when  the  V/UHF  T/B  is  rminaif  act-ve  on  'ran ami ’  nni  is 
required  to  transmi t 

Iff-  snip  TX-  IMS  REQtEST  :  This  is  jiseixio  transitory  sta'e  which  is  entered  when  IF  transmission  13  no 

longer  required 

iff'  OTARI  TX' IMS  REQUEST  This  is  pseixkj  n-uiaitoiy  Va*e  which  is  e->»eied  when  IF  transmission  is 

V’UIF  STOP  TX'IMj  REQUEST  :  This  is  a  pseudo  nr ans  1  tory  state  which  is  entered  when  V/UHF  transmission  is  no 
longer  required 

V'UIK  START  TX'ING  REQUEST  This  »s  pseirio  ’rarun'ory  state  which  is  enteted  when  V'’»F  'lansmission  's 
requited 


DESCRItTlOi  OF  SlQftlg 
TOWER  APPLIED  : 

active  tx  on  w  : 

ACTIVE  TO  ON  V/UHF  ! 

Iff'  T/R  TX' IMG  : 

Iff  T/B  NOT  TX'ING  = 

V.'l  OT  T/B  TX'  IMG  : 

VHP  T/R  NOT  TX*  INC  1 
TOT  <*)  : 

tot  m  : 

AERIAL  UPPER  : 

SQUELCH  IN  ; 

sauncn  mrr  : 

DISABLE  NORMAL  'IP  PSP  : 


This  signal  is  internal ly  geier-ited  when  contns  has  power  applied 

This  signal  is  a  cmrand  firm  'he  avionics  bus  controller  ’  <wcu».iwe  for  the 
iff  tx*n*M»*ei  »«  t*aw  active  and  to  t  raven  it  when  ‘he  ITT  is  pressed. 

This  signal  is  a  ocrrwwl  firm  tin.  avionics  bus  controller  '  executive  for  'he 
V/Uff  tranatnt'ei  »o  lecOne  artive  and  to  tranRni'  when  'he  TOT  is  [xessed 

This  signal  is  internally  generated  when  'he  HE  T/R  is  'rananitting 

This  signal  is  internally  gwiera'ed  when  the  iff  T'R  is  no*  nanami"  ing 

This  signal  is  internally  qcnei **.«•}  when  >b«  V'UUF  T/R  ■*  *  1  .in»m  "  ■  no 

This  siqnal  is  m'emalty  generated  when  'he  iff'  T'R  is  no*  iransni'tinq 

This  is  an  avionics  bus  controller  /  executive  i-omand  for  'he  aC  ive  TH  'o 
start  ti-anan  1  ♦  *  i  ng 

This  is  an  avicriics  txis  controller  '  executive  coimand  foi  'he  •ao'ive  T  p  ’ey 
cease  trananission 

•this  is  an  avionics  bus  controller  >  executive  Orrwvwi  fot  'he  upper  aerial  *o 
l».  selected 

This  is  an  avionics  bus  control  lei  /  executive  Qairwid  foi  the  squelch  on  'he 
V/UHF  T/B  to  be  enabled 

This  is  an  avionics  hue  oont i-ol  let  ■'  executive  Orrivwl  foi  'he  squelch  cm  'he 
V/UHF  T.'tt  to  be  disabled 

This  signal  is  internally  qaiera*ed  when  normal  operation  of  'he  arms  m  no 
lcmgei  required  nr  avai  I  able 


CCFINITICN  OP  ACTIOg 

Ac*icn  (  1 3  Send  State  response  ' Ti anami ' ►  er  active  cm  Iff'' 

Action  [2]  1.  Seoi  State  ies|ionse  'Tranwiittei  active  on  V/UHF' 

Action  (  3 J  1 .  Generate  'he  internal  signal  ■>»'  T/R  START  TX'ING'  fo«  the  iff'  T  B  FSP 
Action  (4]  l.  Send  SNR  Neither  T/R  tranxmi'*  ing' 

Action  1  >]  I.  Generate  the  internal  signal  'iff'  T'P  STOP  TX'IMV  for  'he  !F  T  P  FSP 

2.  Generate  the  internal  signal  'V'UUF  T/R  OTART  TX'ING'  foi  ’he  V.'l  IF  T'P  Mil* 

J.  FbiTM'  sta*e  response  'Tjan«mi"er  active  cm  V/UHF' 

Action  (t,]  l.  Generate  the  internal  signal  iff  T/R  STOP  TX'ING'  for  'he  iff  T'R  FSP 

Ac- ion  (7)  1.  Generate  'he  internal  signal  'V/UUF  T/B  START  TX'IMV  foi  'he  V/UMK  T'P  ESP 

Action  '8]  l.  GeoeiHe  *he  internal  signal  'V/UMK  T/B  STOP  TX'ING'  for  'he  V/UIF  T'P  tSP 
?-  Generate  the  internal  signal  iff'  T/R  STAOT  TX'ING'  foi  ’he  iff  T/B  FSP 

3.  fVjtma'  state  response  TranMiut'er  active  on  iff' 

Action  [g)  1.  Generate  the  internal  signal  'V/t*ff  T/R  STOP  TX'IMV  foi  'he  V/UMF  T/B  FSP 
Action  [IO]  1.  Send  s'ate  response  'IF  T/R  TX'IJC' 

Action  til]  l-  Semi  s'ate  response  (TVanwnit  ormand  ignoied' 'o  acXnowledge  PIT  on  9C.V 
Action  112]  1.  Send  state  response  'V/UIF  T/R  TX'rNG' 

Action  [lj)  1.  Send  s'ate  response  'Upper  Aerial  se'..  ted1 

Action  tl4]  i.  Send  s*a*e  lesponse  'Iciwcer  Aerial  ae looted ' 

Act.icxi  (15]  1.  Send  state  response  'Squelch  in' 

Action  (lb]  1.  Send  state  ies|me»  'Squeloh  ou*  * 

Action  1 17)  I.  Interrogate  bit  5  of  State  Omtrol  itoid  1  and  geneiate  one  of  *he  following  signals. - 
VOTIVE  TO  ON  Iff"  -  bl»  5  se*  »o  '1'  or  'ACTIVE  TX  CN  V A(HF'  hi*  S  set  tQ  'O’ 


Figure  14  Communication  Syitem  FSP 
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SUMMARY 

Advanced  cockpit  design  requires  geometry  improvements  to  accommodate  greater  pilot 
percentile  ranges,  to  reduce  pilot  fatigue  and  discomfort,  to  increase  G-load  resistance, 
and  to  allow  a  different  ejection  path. 

Simulator  trials  have  been  accomplished  to  optimize  the  installation  positions  of  control 
devices  for  different  seat  angles,  the  control  parameters  including  gain  and  force  gra¬ 
dients  as  well  as  the  use  of  force  and  displacement  signals.  The  simulator  results  will 
be  scaled  for  inflight  use.  Adaptive  gain  shaping  and  a  reduction  of  control  forces  using 
nigher  controller  damping  have  been  tested. 

A  method  for  reducing  the  risk  of  loss  of  consciousness  (LOCI  and  means  to  increase 
pilot  efficiency  will  be  discussed. 


1.  INTRODUCTION 

Great  advancement:  have  been  made  in  the  development  of  mission  adaptive  control 
systems,  but  no  serious  attempt  shows  up  to  fit  the  pilot's  environment  to  human  require¬ 
ments.  Looking  at  present  cockpit  and  control  layout,  you  will  find  workable  compromises 
only. 

COCKPIT  GEOMETRY 

There  are  several  new  aspects  which  affect  advanced  cockpit  design. 

Anthropometric  dimensions  -  These  dimensions  increase  at  a  fairly  constant  rate,  but  the 
flight  medical  center  of  the  German  Air  Force  recently  discovered  an  unproportional 
increase  of  the  upper  leg  length.  This  dimension  interferes  essentially  with  the  ejection 
clearance  of  the  cockpit. 

Seat  ejection  path  -  To  avoid  back  injuries  during  ejection  it  is  requested  to  have  the 
ejection  line  not  only  parallel  to  the  back  tangent  line,  but  rather  at  a  negative  angle 
(e.g.  CREST  program).  The  resulting  ejection  path  again  interferes  with  cockpit  and  wind¬ 
shield  structures . 

Pilot  comfort  and  endurance  -  A  seat  back  tangent  angle  of  22  degrees  seems  to  give  the 
most  comfortable  and  relaxed  sitting  position  for  most  of  the  mission  phases  except  short 
range  air  to  air  combat.  Using  an  adjustable  seat  in  the  simulator,  the  majority  of  the 
pilots  adjusted  the  seat  back  to  22  degrees,  some  preferred  less  but  no  one  more. 

Those  familiar  with  cockpit  design  know  that  the  required  anthropometric  ranges 
cannot  be  accommodated  at  22  degrees  back  tangent  position  by  the  use  of  center  stick  and 
standard  seat  height  adjustment. 

For  the  simulation  trials,  however,  the  control  devices  have  been  optimized  to  fit 
the  22  degree  seat  installation  position  because  some  human  research  development  programs 
include  better  adjustable  seats. 

SIMULATIONS  TO  OPTIMIZE  CONTROL  DEVICE  PARAMETERS 

Being  well  aware  of  some  fundamental  divergences  between  simulator  and  inflight 
results  in  the  past,  efforts  have  been  made  to  avoid  recognized  deficiencies. 

Therefore  every  simulation  setup  was  checked,  using  a  very  selective  handling  quali¬ 
ty  criterion  which  also  includes  the  control  forces.  A  lead-lag  element  of  the  flight 
control  system  was  shaped  in  order  to  move  the  individual  setups  as  close  as  possible  to 
the  optimum  within  the  level  1  area. 

To  compensate  the  low  stress  and  lack  of  motion  feedback  of  the  fixed-based  simula¬ 
tor,  a  very  demanding  or  even  exaggerated  pilot  task  was  selected  to  enforce  continuous 
closed  loop  control. 
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2.  SIMULATOR  TRIALS  WITH  SIDE  AND  CENTER  STICK 

The  purpose  of  these  simulations  was  to  determine  parameters  and  transfer  gain 
shapings  for  future  airborne  application. 

EQUIPMENT  DESCRIPTION 


A  fixed-base  simulator  with  HUD  and  a  single  channel  visual  system  were  used  for  the 
trials. 


The  total  time  delay  including  all  elements  was  between  50  and  90  msec. 

The  electro-hydraulic  force  loader  for  center  and  side  stick  allowed  the  variation 
of  the  following  parameters: 


control  forces 
d i splacements 
force  gradients 
breakout  forces 


maximum  velocity 
dead  band 
friction 
damp i ng 


Force,  displacement  and  rate  sensing  signals  were  available  for  further  processing. 


INSTALLATION  GEOMETRY 


The  position  of  the  grip  reference  point  in  relation  to  the  neutral  seat  reference 
point  (NSRP)  and  the  operation  axes  of  the  controls  were  optimized  in  order  to  achieve 
the  highest  level  of  comfort,  ease  of  handling  and  be  operable  within  the  required  per¬ 
centile  range.  The  attained  installation  positions  for  both  applications  are  shown  in 
f i gure  1 . 


INSTALLATION  POSITION 

Seat  back  tangent  22° 

SIDE  STICK 

CENTER  STICK 

Grip  re*erence  point 
‘orward  of  NSRP 

15  75  m  1400  mm  1 

20  3  m  <515  mml 

Grip  reference  pomt 
above  NSRP 

*0  6  m  (270  mm) 

9  Bin  1249  mml 

Offset  right  0»  centerline 

*  1  8  m  (300  mml 

0  4  in  ( 10  mm) 

Plane  of  pitch  steering 
in  relation  to  X  axis 

in  relation  to  Z  axis 

15°  clock  wise 

14  5°  clockw.se 

19  5°  cc 

8°  clockwise 

Plane  of  roll  steering 
in  relation  to  Z  axis 

19°  counter  clockwise 

0° 

Figure  1 

Note  that  the  operating  axes  attained  for  the  center  stick  installation  are  diffe¬ 
rent  from  conventional  use,  but  were  positively  accepted  or  even  passed  unnoticed  by 
pilots  used  to  standard  geared  center  stick  installations  in  fighter  aircraft  for  up  to 
20  years. 

SIMULATION  SETUP 

Pilot  task  -  The  pilots  had  to  track  an  airborne  target  which  was  programmed  to  execute 
40  fairly  erratic  maneuvers  following  some  steady  fl'qht  phases.  Figure  2  shows  an 
example  of  the  targets  flight  behaviour. 


Figure  2  Target  maneuvers 


Frequencies  and  rates  for  pitch  and  roll  commands  were  varied  considerably  and  the 
maneuvers  have  been  rearrarged  on  a  random  basis,  for  every  run,  to  avoid  control  anti c  1 
pation,  forcing  the  pilots  to  a  closed  loop  interaction  at  any  time.  The  task  was  also 
set  up  to  exceed  real  flight  situations  in  magnitude  and  duration  in  order  to  compensate 
the  low  stress  fixed-base  simulator  trials. 

Control  input  limitations  -  To  minimize  distractions  caused  by  the  requirement  for  addi 
tional  control  manipulations,  the  power  control  was  done  automatically,  the  rudder  con¬ 
trol  disconnected  a  "  d  a  fixed  sight  was  used. 

Selection  of  control  parameters  -  Because  it  is  virtually  impossible  to  change  all  rela 
ted  parameters  within  one  simulation  campaign  and  still  achieve  a  statistically  relevant 
number  of  ratings,  some  factors  had  to  be  preoptimized,  such  as  control  friction,  break¬ 
out  forces,  dead  band,  damping  and  switch-over  points. 

As  shown  in  figure  3  for  the  side  stick  and  in  figure  4  for  the  center  stick,  a 
large  number  of  positions  within  the  initial  force/gair  and  force/di splacement  diagrams 
have  been  selected  to  shape  the  total  gradients  used  for  the  simulator  trials. 

Figure  3  also  shows  the  recommended  boundaries  of  previous  inflight  simulations 
downscaled  for  fixed  base  simulator  use. 
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Figure  3  Side  stick  gradients 


Figures  4  and  5  show,  in  addition  to  the  selected  positions,  the  downscaled  gra¬ 
dients  of  experimental  and  operational  fighter  aircraft  in  use  (02,  2,  04,  4)  as  well  as 
the  lower  dynamic  and  static  boundaries  according  to  M1L-C-9785C. 


Figure  4  Center  stick  gradients 


Figure  5  Center  stick  gradients 


Gain  shaping  -  cor  the  initial  force/gain  gradients,  linear  slopes  were  used  for  pitch 
and  roll  command  up  to  8  percent  of  the  total  maneuver  potential  for  the  side  stick  and 
15  percent  for  the  center  stick.  The  remaining  potential  is  controlled  via  a  parabolic 
shaped  gain  gradient.  This  approach  was  used  to  attain  the  necessary  scaling  for  preci" 
sion  tracking  in  combination  with  acceptable  force  levels  at  the  maximum  maneuver  points 
and  to  avoid  corners  at  the  switch-over  points.  These  points  have  been  preoptimized  and 
it  was  amazing  to  see  that  the  preferred  initial  force/gain  gradient  was  larger  for  the 
side  stick  compared  with  the  center  stick. 

Control  forces  and  roll  asymmetries  -  As  a  reference  for  the  selection  of  control 
forces,  all  available  information  on  experimental  and  operational  fighter  type  aircraft 
have  been  considered.  The  forces  for  roll  command  inputs  to  the  right  have  been  reduced 
until  both  directions  were  reported  to  require  similar  effort  (Figure  5). 

Flight  control  system  -  Pitch  and  roll  rates  have  been  used  as  main  control  parameters 
with  maximum  attainable  G-load,  angle  of  attack  and  roll  rate  as  limiting  factors.  During 
every  cycle  the  maximum  attainable  loads  and  rates  ha*«e  been  ~omputed  as  a  function  of 
airspeed  and  the  direction  of  airflow.  The  gain  shaping  then  was  adjusted  to  achieve 
correlation  between  maximum  stick  force/deflection  and  the  momentary  aircraft  potential 
in  any  phase  of  flight. 

By  these  means  the  flight  handling  characteristics  are  almost  similar  to  a  conven¬ 
tionally  controlled  aircraft,  and  any  distracting  dead-stick  portions  -  with  the  pilot 
out  of  the  loop  -  are  avoided.  Figure  6  shows  an  example  of  the  force/gain  shaping  for 
the  roll  and  pitch  command  signals  the  asymmetric  roll  forces  and  the  matching  to  the 
momentary  maneuvering  potential  give  the  pilot  the  opportunity  to  sense  the  aircraft 
potential  without  wat  ning  indicators. 


Figure  6  Example  of  force/gain  shaping 


To  measure  the  pilots'  command  inputs,  force  and  displacement  sensing  arrangements 
were  available,  as  well  as  the  combination  of  both. 

Flight  handling  criterion  -  To  compare  stick  parameters  and  transfer  shaping  it  was 
necessary  to  have  identical  handling  characteristics  with  changing  force/gain  gradients. 
Looking  for  a  criterion  to  determine  the  handling  qualities  of  a  digital  flight  control 
system  including  control  forces  and  aircraft  parameters  we  found  the  Phase/Gain  Margin 
Criterion  the  most  selective  (Reference  2  and  3). 

Figure  7  shows  the  BODE  plot  where  the  Phase/Gain  Margin  Criterion  takes  the  pha^e  margin 
6 m  at  the  crossover  frequency,  the  gain  margin  Gm  at  the  180°  phase  point  and  the  maximum 
overshoot  of  the  frequency  response  I G  I  ma  x . 


By  adjusting  the  lead-lag  element  of  the  flight  control  system,  it  was  possible  to 
shift  most  of  the  force/gain  combination  to  the  area  of  the  expected  optimum  for  fighter 
type  aircraft  within  Level  1  (figures  8  and  9). 

For  the  side  stick  arrangement  the  shapings  number  23_27  and  74-77  exceed  the 
Level  1  area  of  the  gain/phase  margin  diagram.  Number  74-77  also  exceed  the  Level  1 
boundary  of  10  dB  for  the  maximum  frequency  overshoot.  For  the  center  stick  the  shapings 
number  2,  04,  4M  and  11-14  also  exceed  the  Level  1  boundary  of  the  frequency  overshoot. 
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The  center  stick  trials  have  been  accomplished  by  10  pilots  -  4  flight  test  and  6 
operational  military  pilots.  A  total  of  110  hours  of  simulator  time  was  used. 

The  individual  rating  as  an  average  of  the  Cooper  Harper  and  the  Pilot  Opinion 
Rating  and  the  average  ratings  of  all  pilots  are  shown  in  figure  11  for  the  side  stick 
and  in  figure  12  for  the  center  stick. 

In  addition  to  the  individual  ratings,  10  task  related  parameters  have  been  collec¬ 
ted  at  every  computation  cycle  and  accumulated  over  the  total  task  period  to  see  whether 
there  was  any  correlation  between  individual  ratings  and  obvious  tracking  deviations. 
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Figure  1 1  Side  stick  ratings 
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DISCUSSION  OF  RESULTS 


Compared  with  similar  simulation  trials  the  spread  of  the  individual  ratings  can  be 
considered  normal.  But  as  the  number  of  pilots  gave  a  sufficient  data  base,  the  average 
ratings  point  fairly  straight  towards  a  specific  area  of  the  force/gain  and  force/dis¬ 
placement  diagrams. 

There  are  two  possible  explanations  for  the  relative,  low  overall  rating 

•  The  tracking  task  was  exaggerated  on  purpose  to  enforce  closed  loop  control 

•  Some  roll/yaw  coupling  effects  of  the  aircraft  model  which  were  slightly  distracting 

especially  during  rapid  reversals. 

Side  stick  -  It  was  amazing  to  see  that  the  best  ratings  among  the  side  stick  results 
showed  up  for  the  initial  force/gain  ratio  of  4  and  6  Lbs/G  in  the  area  of  15  to 
17  Lbs/inch  for  the  f orce / d i sp 1 aceme nt  but  the  setups  at  5  Lbs/G  were  downgraded 
(figure  3).  The  reason  of  these  rating  deviations  was  uncovered  to  be  that,  because  of 
the  shapings  of  force/gain  and  force/displacement  gradients,  the  d i spl aceme nt / ga  i  n 
gradient  ended  up  with  a  reversion  point.  Thus  we  learned  that  the  human  controller  is 
not  only  sensitive  to  force/gain  shaping  but  to  d i spl acement /ga i n  shaping  as  well. 

Another  main  difference  between  the  best  rated  shapings  number  46  and  66  M  was  an 
increase  of  damping  for  pitch  command  input  by  a  factor  10  for  number  66  M. 

During  the  side  stick  trials  mainly  the  force  sensing  signals  were  used  to  drive  the 
flight  controls  system  but  some  tentative  simulations  showed  that  a  mix  of  force  and  dis¬ 
placement  signals  would  improve  the  ratings. 

Center  Stick  -  The  center  stick  simulations  showed  the  best  average  rating  at  approxi¬ 
mately  2.5  Lbs/G  for  the  initial  force/gain  ratio  and  7  Lbs/inch  for  force/displacement. 
For  most  setups  a  12  times  higher  damping  factor  for  pitch  control  compared  to  roll  con¬ 
trol  and  a  blended  force/displacement  sensing  signal  was  used  (figure  13).  The  forces  for 
roll  input  right  were  reduced  and  a  noticeable  difference  between  the  dead  band  required 
for  pitch  and  roll  commands  was  discovered. 


The  additional  letter  markings  behind  the  shaping  numbers  in  figure  12  stand  for: 

D  ...  equal  damping  for  pitch  and  roll  commands 
F  ...  force  sensing  signal  only 

G  ...  reduced  force /d i spl acement  gradients  for  roll  inputs  to  the  right. 

During  the  first  portion  of  the  simulation  trials  setups  which  attained  level  3 
ratings  were  dropped. 

After  continuous  comments  like  ■forces  to  the  right  feel  heavy  and  not  harmonized* 
with  a  reduction  to  66  percent  of  the  forces  for  left  roll  commands,  the  f or ce / d i sp 1  ace  - 
went  gradient  to  the  right  was  reduced  maintaining  the  previous  forces  until  it  felt 
equal  in  both  directions. 

Comparison  between  side  and  center  stick  results  -  Looking  at  the  diagrams  of  figure  14 
and  15  which  show  the  best  rated  simulator  solutions  scaled  for  inflight  use,  some 
remarkable  differences  can  be  seen? 

Initial  force/gain  ratio 

5.1  Lbs/G  for  the  side  stick 
3.75  Lbs/G  for  the  center  stick 


25-10 


Until  the  moment  when  unmistakable  medical  indications  of  approaching  LOC  were  dis 
covered,  this  type  of  load  compensation  could  be  used  mainly  because  the  muscle  tension 
was  found  to  be  kept  constant  for  an  extended  period  of  time  after  LOC  occurred. 

To  command  emergency  G-load  conditions  or  angles  of  attack  in  excess  of  maximum 
lift,  further  increase  of  control  force  will  be  required. 


Figure  16  Example  of  G-load  compensation 


MECHANIZATION  OF  CONTROL  DEVICES 

During  the  simulation  trials  all  parameters  have  been  used  and  optimized  from  the 
point  of  view  of  simple  and  inexpensive  mechanization  for  inflight  use  to  avoid  additio¬ 
nal  equipment  and  systems  being  installed,  just  to  generate  unnecessary  sensations  to  the 
ope  rator . 

Friction  was  reduced  to  a  point  which  may  be  expected  from  the  mechanized  device. 
Velocity  limit  was  set  to  a  setting  where  it  had  no  influence  on  the  rating.  It  also  was 
found  that  varying  slopes  for  the  force/displacement  gradients  were  not  required. 

Damping  was  kept  at  a  constant  value  and  differed  only  for  pitch  and  roll  control. 

Therefore  only  a  simple  spring  and  damper  arrangement  is  required  for  airborne 
i  nstal  lat  ions  . 

Blending  of  force  and  displacement  signals  -  The  simulations  showed  that  the  blending  of 
signals  improved  the  handling  of  momentary  response  and  precision  tracking  for  most  of 
the  gradient  combinations. 

Figure  17  shows  a  scheme  of  the  signal  shape  as  a  function  of  rate  and  damping. 

Plots  showed  up  to  70  msec  spacing  between  signals  at  maximum  manual  input  rate.  This 
indicates  that  there  is  room  for  optimizing  the  system  to  the  pilot  inputs  -  especially 
rate  and  size  -  to  fit  the  momentary  aircraft  potential  and  the  pilot's  intentions. 
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Figure  17 
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Safety  aspects  -  As  the  installation  position  of  force  and  displacement  sensing  trans¬ 
ducers  may  well  be  separated  and  either  package  is  sufficient  for  aircraft  control,  there 
is  additional  redundancy  in  case  of  damage.  Even  a  totally  stuck  controller  will  allow 
aircraft  control  at  slightly  degraded  modes. 

Active  control  devices  -  Using  optimized  signal  blending  and  gain  shaping  an  advantage 
for  the  application  of  an  active  control  device  is  not  visible,  only  disadvantages,  viz. 
extra  weight,  cost,  complexity,  additional  time  lags  and  flight  safety  risks. 

Arm  rest  -  The  center  stick  installation  should  be  arranged  to  give  the  majority  of  the 
pilots  the  chance  to  rest  their  arm  on  their  right  upper  leg. 

For  side  s  ♦  i  c  k  installations  an  armrest  is  mandatory.  The  armrest  has  to  be  adjust¬ 
able  to  fit  all  anthropometric  dimensions  and  compensate  normal  and  sideloads.  Up  to  this 
point,  it  was  self-explanatory,  but  simulations  showed  that  tracking  performance  as  well 
as  pilot  ratings  improved  with  an  armrest  installation  that  supported  but  did  not  lock 
the  natural  geometry  of  movement.  At  the  same  time  it  was  found  that  the  movement  of  the 
armrest  must  by  no  means  introduce  additional  motion  patterns. 

This  may  require  adjustable  pivot  points  and  well  defined  force/displacement 
gradients  for  maximum  pilot  comfort. 


4.  INCREASING  PHOT  EFFICIENCY  THROUGH  WORKLOAD  REDUCTION 

Information  display  and  system  handling  -  Due  to  increasing  specialization  and  diversi¬ 
fication  of  equipment  suppliers  as  well  as  new  or  additional  system  functions,  we  see  a 
culminating  tendency  to  increase  the  number  of  information  and  controls  in  the  cockpit. 
This  increase  of  workload  causes  a  decline  of  pilot  efficiency. 

The  introduction  of  data  entry  keyboards  optically  reduced  the  number  of  controls 
and  switches  but  did  not  reduce  workload  because  the  pilot  has  to  memorize  codes  and  is 
forced  to  identify  optically  numerous  push-buttons  which  takes  more  time  than  flicking  a 
designated  switch. 

Therefore  we  must  look  at  any  system  function  and  information  requirement  for  the 
primary  and  secondary  mission  to  identify  sequential,  parallel  or  commonly  triggered 
functions  to  reduce  the  controlling  effort. 

If,  for  example,  the  pilot  wants  his  aircraft  to  be  e 1 ec t r omagne t i c a  1 1 y  silent,  it 
does  not  make  sense  to  page  half  a  dozen  system  layouts  to  the  displays  trying  to  iden¬ 
tify  the  respective  RECEIVE  ONLY  switch,  whereas  a  single  button  press  •SILENT-ON'  as 
HOTAS  function  can  take  care  of  all  active  systems  at  the  same  time. 

Any  detailed  analysis  of  system  functions  and  operational  requirements  will  uncover 
numerous  possible  interconnections  and  means  to  streamline  the  controlling  effort  to 
improve  pilot  efficiency. 

Data  input  inflight  must  be  kept  at  an  absolute  minimum,  which  means  manual  entry  of 
frequencies  and  codes  for  communication,  navigation  or  identification  will  not  occur 
during  a  standard  operational  mission.  Every  effort  must  be  made  to  have  sufficient  per¬ 
manent  and  premission  storage  capacities  available  and  have  the  required  data  either 
automatically  available  or  easily  accessible. 

Tentative  research  work  at  our  simulator  shows  that  Direct  Voice  Input  may  be  a  use¬ 
ful  means  for  data  input  but  only  under  relaxed  environmental  conditions  and  not  on  a 
rout i ne  basis. 

HOTAS  functions  -  Parallel  to  automatic  system  functions  optimized  HOTAS  arrangements 
are  considered  the  best  means  to  increase  pilots  efficiency.  But  on  the  assumption  that 
the  hand  position  at  stick  and  throttle  tops  must  not  change  and  all  switches  must  be 
accessible  throughout  the  anthropometric  range,  only  a  limited  amount  of  functions  is 
available.  In  addition,  switch  handling  must  not  interfere  with  aircraft  control  and 
simultaneous  switching  functions  at  the  same  grip  should  be  avoided. 

In  order  to  have  immediate,  unrestricted  and  unobstructed  access  to  any  switch  - 
which  is  of  vital  importance  especially  during  air  to  air  operations  in  a  multi-bogey 
environment  -  no  additional  safety  covers  or  guards  (like  late  arm  switches  etc.)  can  be 
tolerated.  The  required  operating  speed  for  associated  functions  in  combination  with 
rapidly  changing  body  positions,  introduces  the  risk  of  repositioning  these  obstructions. 
Which  means  the  switch  functions  are  not  available  if  required  and  there  may  be  no  second 
chance . 

Figures  18  and  19  show  possible  arrangements  and  functions.  Especially  the  4  and  5 
position  switches  and  force  transducers  allow  various  related  functions,  e.g.  combined 
control  of  sensors,  seekerheads,  HUO,  head-down  display  and  helmet  mounted  sight. 

These  stick  and  throttle  tops  are  in  operation  at  the  simulator  cockpit.  Future 
trials  will  be  required  to  achieve  the  integration  of  main  function  and  deviations 
thereof. 
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ACTIVE  AND  PASSIVE  SIDE  STICK  CONTROLLERS: 
TRACKING  TASK  PERFORMANCE  AND  PILOT  CONTROL  BEHAVIOUR 


by 


R.J.A.W.  Hosman  and  J.C.  van  dc-r  Vaart 
Faculty  of  Aerospace  Engineering 
Delft  University  of  Technology 
Delft  -  The  Netherlands 


SUMMARY 


A  servo  controlled  side  stick  featuring  hydraulic  actuators  with  hydrostatic  bearings 
was  deve Loped  at  Delft  University  of  Technology.  Due  to  its  smooth  operation,  low  noise 
characteristics  and  high  bandwidth  (70  Hz.),  a  great  variety  of  dynamic  characteristics 
(apparent  mass,  damping  and  spring  force  gradient)  can  be  simulated.  This  research  tool 
can  very  conveniently  be  used  as  a  conventional  "passive"  stick  to  assess,  for  instance, 
the  desired  side  stick  dynamics  for  future  Fly  By  Wire  aircraft. 

Still  more  important  is  that  with  a  servo  controlled  side  stick,  stick  force  and  stick 
displacement  can  be  controlled  virtually  independent.  This  characteristic  can  be  used 
for  experimental  research  to  investigate  the  perception  and  feedback  of  stick  force  and 
stick  displacement  by  the  pilot's  neuromuscular  system  in  the  control  task. 

After  a  short  description  of  the  side  stick  controller  hardware,  results  of  a  tracking 
experiment  in  the  Aerospace  Faculty's  moving  base  flight  simulator  will  be  presented.  In 
this  experiment  the  side  stick  was  used  as  a  passive  as  well  as  an  active  (aircraft 
output  feedback  via  the  stick  position)  controller.  Considerable  improvement  in  tracking 
performance  and  significant  changes  of  measured  pilot  control  behaviour  were  found  for 
the  "active"  when  compared  to  the  "passive"  control  stick. 


1 .  Inc  roduc t i on 


A  recent  paper  by  Johnston  and  McRuer  on  Limb-Side  Stick  Dynamic  Interaction  on  Roll 
Control  gives  a  review  on  the  problems  encountered  in  almost  every  new  aircraft  with  Fly 
by  Wire  control  systems.  See  Ref.  1.  Pilot  induced  oscillations,  roll  ratchet, 
biodynamic  interactions,  etc.,  are  well  known  problems  often  highlighted  in  literature 
during  the  last  decade.  Interaction  of  the  high  performance  flight  control  systems  and 
neuromuscular  system  dynamics  seems  to  be  the  major  cause  of  these  problems.  Besides  the 
roll  control  problem  just  mentioned,  it  is  known  that  the  development  of  the  side  stick 
in  the  Fly  by  Wire  controlled  Airbus  A  IZQ  did  raise  many  questions  from  the  evaluation 
pilots  of  the  airlines  and  still  does  so. 

At  the  Faculty  of  Aerospace  Engineering  of  the  Delft  University  of  Technology  a  long 
terra  research  program  directed  to  a  better  understanding  of  pilot's  behaviour  in 
aircraft  control  was  started  around  1980.  The  program  is  especially  directed  at  the 
information  processing  by  the  pilot  when  controlling  the  aircraft.  Since  th*»  inFormation 
processing  by  the  human  controller  starts  with  perception,  the  research  program  was 
initially  aimed  at  the  perception  of  the  motion  state  of  the  aircraft.  This  work 
provided  insight  in  motion  perception  from  central  and  peripheral  visual  cues 
(instruments  and  outside  word)  and  vestibular  (motion)  cues  but  also  provided  methods 
and  experience  in  i nves t i ga t i ng  the  pilot's  use  of  these  resources  when  performing  his 
task .  See  Ref .  2 . 

After  the  success  of  the  initial  program  on  motion  perception  a  second  program  directed 
on  pilot’s  control  was  started.  It  was  realized  that  in  order  to  investigate  the  control 
behaviour  -  especially  the  way  the  pilot  generates  his  control  output  and  how  he  reacts 
on  the  perceived  stick  force  and  stick  displacement  -  a  special  manipulator  had  to  be 
built  to  obtain  the  possibility  of  modulating  subject's  control  output  during  laboratory 
experiments.  It  was  decided  that  a  servo  controlled  side  stick  was  most  appropriate  for 
this  purpose.  The  advantage  of  such  a  manipulator  is  that  the  stick  force  and  stick 
displacement  can  be  made  independent.  This  yields  the  possibility  to  influence 
subject's  output  generation.  Given  the  broad  experience  on  electro  hydraulic  servo 
systems  available  at  the  University,  obtained  with  flight  simulator  motion  and  loading 
systems,  the  development  of  a  electro  hydraulic  servo  controlled  side  stick  was  started. 
Electro  hydraulic  servo  motors  have  the  advantage  of  a  high  bandwidth  (w,i  SO  Hz.)  of 

the  position  control  system  and  therefore  can  generate  fast  changes  of  stick  position. 

With  such  a  side  stick  the  following  research  subjects  can  be  tackled: 

-  static  and  dynamic  characteristics  of  the  neuromuscular  system  of  the  arm 

-  design  criteria  for  side  sticks  i.e.  zero  position,  maximum  deflection,  breakout 
forces,  spring  stiffness,  damping  etc. 

-  the  use  of  the  side  stick  as  a  passive  or  active  manipulator. 


The  first  step  was  to  develop  a  single  axis  servo  controlled  side  stick  based  on  a 
modified  servo  motor  of  the  electro-hydraulic  control  system  of  our  laboratory  aircraft. 
In  addition  a  literature  study  on  the  ergonomic  aspects  of  side  stick  controllers  was 
performed.  See  Ref.  3.  Some  experience  with  that  single  axis  side  stick  was  obtained  and 
is  reported  in  this  paper. 

After  the  design  of  the  single  axis  side  stick  control  system  was  completed,  see  Fig.  1. 
a  two  axis  side  stick  was  developed  which  side  stick  is  now  available  for  research.  See 
Fig.  2. 

So  far  two  experiments  have  been  performed  with  the  single  axis  side  stick.  One  was 
directed  to  the  perception  of  static  values  of  stickforce  and  stick  displacement.  This 
study  showed  clearly  the  asymmetry  in  the  sensors  of  the  neuromuscular  system  when 
perceiving  static  stick  force  and  displacement  in  the  roll  axis. 

The  second  experiment  was  a  tracking  experiment  to  investigate  the  influence  of  the 
feedback  of  perceived  stick  force  and  stick  displacement  on  the  tracking  behaviour  of 
the  subjects.  As  will  be  shown  in  this  paper  a  remarkable  change  in  control  behaviour 
and  performance  can  be  obtained  if  suitable  variables  are  fed  back  to  the  subject  by  way 
of  the  stick  position. 

In  the  next  chapter  the  principal  difference  between  passive  and  active  side  sticks  will 
be  discussed.  In  chapter  3  the  test  facility  and  in  chapter  4  the  tracking  experiment 
will  be  described.  The  results  are  given  in  chapter  5  and  in  chapter  6  the  conclusions 
will  be  drawn  after  a  short  discussion. 


2.  Pasai je  and  Active  manipulators 


In  the  tracking  experiment  reported  in  this  paper,  the  side  stick  was  applied  as  a 
passive  and  as  an  active  controller. 

Before  going  into  the  details  of  the  tracking  experiment,  it  seems  appropriate  to  stress 
the  distinction  between  the  two  controllers.  When  a  servo  controlled  manipulator  is  used 
to  simulate  the  dynamic  characteristics,  breakout  forces,  etc.  of  a  side  stick  as  used 
in  a  fly  by  wire  controlled  aircraft,  such  as  the  F  16,  then  it  may  be  called  a  passive 
side  stick.  In  Fig.  3-  it  is  shown  how  a  passive,  servo  controlled  side  stick  fits  in 
the  control  loop.  The  measured  stickforce  is  the  input  to  the  model  of  the  side  stick 
dynamics  in  a  computer.  The  stick  displacement,  the  model  output,  is  the  control  signal 
to  the  aircraft,  as  well  as  to  the  position  control  loop  of  the  side  stick. 


In  the  last  ten  to  fifteen  years  research  has  been  performed  at  a  number  of  research 
institutes  on  the  subject  of  so  called  active  controllers.  See  Refs.  3.  4,  5  and  6. 
Although  the  meaning  of  the  term  "active  controller"  may  vary  among  authors,  common  to 
all  active  controllers  reported  in  literature  is  the  use  of  a  servo  system  for  the 
control  of  the  manipulator.  In  this  paper  the  term  "active"  is  used  when  the  stick  force 
is  the  input  to  the  aircraft  control  system  and  an  aircraft  state  or  output  variable  is 
the  input  to  the  position  control  of  the  side  stick.  See  Fig.  4. 

In  case  of  a  passive  side  stick  the  side  stick  deflection  is  the  control  input,  whereas 
in  case  of  an  active  stick  the  deflection  is  proportional  to  system  output  or  an 
arbitrary  combination  of  state  variables. 

Stated  differently,  see  Fig.  3-  and  4,  with  a  p*»Cdive  side  stick  a  pilot  feels  simulated 
stick  dynamics.  With  an  active  side  stick,  he  "feels"  aircraft  dynamics,  since  they  are 
included  in  the  feedback  loop,  (If  control  surface  deflection  is  considered  as  an 
aircraft  state  variable  then  conventional  mechanical  controls  would  fall  into  the 
category  of  active  controllers.) 

If,  for  instance,  the  lateral  deflection  of  an  actual  side  stick  is  equal  to  aircraft 
roll  angle  and  the  lateral  stick  force  is  the  input  to  the  roll  control  system,  then  the 
pilot  can  stabilize  the  roll  angle  by  holding  the  stick  in  a  fixed  position.  A  deviation 
of  the  aircraft  roll  angle  will  give  a  deflection  of  the  side  stick.  The  pilot  will 
automatically  exert  the  appropriate  force  on  the  stick  and  correct  the  roll  angle 
deviation  by  simply  holding  the  stick  fixed  in  the  same  position.  One  might  say  that  the 
pilot  virtually  holds  the  aircraft  in  his  hand. 

By  including  the  active  side  stick  in  the  tracking  experiment,  a  comparison  of  the 
different  feedback  methods  of  passive  and  active  side  sticks,  in  one  experiment,  could 
be  made. 


3.  Test  facilities 


The  experiment  was  performed  in  the  research  flight  simulator  of  the  Faculty  of 
Aerospace  Engineering  of  the  Delft  University  of  Technology.  See  Fig.  5.  In  order  to 
limit  the  number  of  experimental  conditions  in  this  preliminary  exptriment,  the  motion 
system  of  the  simulator  was  not  used.  The  subject  was  seated  in  the  right  hand  seat  and 
held  the  side  stick  in  his  right  hand.  See  Fig.  6.  The  system  dynamics  of  the  roll 
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control  task  was  a  double  integrator  (K/s  ),  see  chapter  4.  The  roll  angle  was  displayed 
on  a  CRT  display  (simulated  artificial  horizon)  in  front  of  the  subject.  See  Fig.  6. 


The  manipulator  used  in  the  experiment  was  a  single  axis  servo  controlled  side  stick 
already  mentioned  in  the  introduction.  See  Fig.  1.  The  position  servo  was  an  electro 
hydraulic  servo  motor  with  hydrostatic  bearings  with  a  Coulomb  friction  of  approximately 
1  Newton.  The  maximum  deflection  of  the  side  stick  was  i  30  degrees.  The  position  of  the 
servo  motor  piston  rod  is  measured  by  using  a  L.V.D.T  (Linear  Variable  Displacement 
Transducer}.  The  control  of  the  servo  motor  was  obtained  with  a  Moog  electro-hydraulic 
control  valve.  The  position  control  loop  is  shown  in  Fi^.  7.  and  the  electronic 
components  of  the  control  loop  are  positioned  close  to  the  side  stick.  The  dynamic 
characteristics  of  the  position  control  loop  can  be  described  by  a  second  order  system 
with  a  natural  frequency  u>9  =  70  Hz  and  a  damping  ratio  C  =  0-5-  The  measured  transfer 

function  is  shown  in  Fig.  8. 

The  stick  force  is  measured  with  strain  gages  so  that  they  are  sensitive  only  to  a  force 
exerted  laterally  on  the  stick  and  not  sensitive  to  a  moment.  In  case  of  a  simulation  of 
a  passive  side  stick,  the  stick  force  is  the  input  to  the  side  stick  model.  This  model 
may  include  second  or  higher  order  dynamics  and  non-linear  components  such  as  a  breakout 
force . 

If  the  dynamic  characteristics  of  the  simulated  side  stick  can  be  described  by  a  second 
order  system  then: 


F(t)  -  my(t)  ♦  wy { t )  ♦  cy(t) 


(3-D 


where  F  is  the  stick  force  and  y  is  the  position  of  the  piston  rod  of  the  servo  motor. 
Due  to  the  geometry  of  the  side  stick  the  transfer  function  describing  the  relation 
between  the  stick  displacement  s  in  degrees  and  the  st-ck  force  in  Newtons  is: 


F  ( s ) 


1000 


as  *  ws  ♦  c 


(3.2) 


where  in:  m  =  simulated  "iass 

w  =  simulated  damping 
c  =  simulated  spring  stiffness 


For  stability  the  simulated  mass  m  and  damping  are  limited  to;  m  :  0.3  kg  and  w  i 
Nsec/m . 

The  spring  stiffness  can  be  varied  over  a  wide  range  of  values,  provided  that  the 
natural  frequency  of  the  simulated  dynamics  remains  well  below  the  natural  frequency  of 
the  position  control  loop  {«,=  70  Hz).  See  for  a  summary  of  details  Table  1. 

Passive  or  active  side  stick  dynamic  characteristics  were  simulated  with  the  analog  part 
of  a  EAI  Pacer  hybrid  computer. 

A  Textronix  604  CRT  display  was  used  to  display  a  simple  artificial  horizon.  See  F;g.  f. 
The  repetition  rate  was  230  times  per  second.  Th  image  was  generated  by  the  analog  part 
of  the  hybrid  computer. 

The  digital  part  of  the  hybrid  computer  was  used  to  control  th  •  experiment,  t  o  generate 
the  forcing  function,  to  record  the  measurements  during  the  performance  n f  the  control 
tasks  and  to  process  measured  data. 


l\  L  The  experiment 


The  aim  of  the  experiment  was  to  compare  the  subject's  performance  and  control  behaviour 
in  a  tracking  task  using  the  servo  controlled  side  stick  simulating  diferont  side  stick 
dynamic  characteristics  and  to  investigate  the  influence  of  stick  force  and  or  stick 
displacement  feedback.  The  rather  academic  dynamics  of  the  roll  control  task  (equal  to 

those  of  a  double  integrator  (K/s  )).  were  chosen  simply  because  much  experimental  data 
is  available  in  the  literature,  see  Ref.  8  and  9.  In  this  way  results  could  be  compared 
with  others  obtained  with  the  same  system  dynamics. 

Two  distinct  control  tasks  were  used  in  the  experiment.  In  the  first,  the  disturbance 
task,  the  disturbing  function  was  made  to  act  on  the  controlled  system,  as  shown  in  Pig. 
9-  This  task  is  quit  comparable  to  the  case  in  which  the  piLot  stabilizes  an  aircraft  in 
turbulent  air.  In  the  second  control  task,  the  target  following  task,  the  displayed 
signal  on  the  artificial  horizon  c .is  the  difference  between  the  forcing  function  i  and 

the  roll  angle  *  of  the  controlled  system.  See  Fig.  10. 

Three  passive  side  sticks  with  different  dynamic  characteristics  and  two  active  side 
sticks  were  used  in  the  experiment.  See  Table  2. 

The  first  passive  side  stick  is  a  simulation  of  a  isotonic  or  pos'tion  stick.  It  is 
simulated  by  a  second  order  system  with  a  spring  stiffness  equal  to  zero  and  a  mass  m  = 
0.5  kg  and  damping  w  =  5  Nsec/m.  The  describing  function  between  the  input  stickforce  F 

a 

and  the  output  stick  deflection  s  is: 
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Fft { s )  s ( s  +  10) 


The  second  passive  side  stick  is  a  simulation  of  a  hardware  manipulator  developed  by  the 
National  Aerospace  Laboratory  N.L.R.  in  Amsterdam  for  research  applications.  See  Ref. 

10.  The  static  relation  between  stick  force  and  stick  deflection  is  given  in  Fig.  11. 
Between  i  18  degrees  stick  deflection  the  dynamic  characteristics  can  be  described  by: 


s  (s )  K 

a  =  _ 

F  (s)  *  * 

a  s  ♦  2Qw,  s  ♦  <j# 


(4.2) 


where  in  w  *  20.8  rad/sec  ana  C  *  0.95* 

The  third  passive  stick  was  a  simulation  of  a  isometric  or  force  stick  by  simply  keeping 
the  stick  deflection  fixed  to  zero. 

The  input  signal  for  the  system  to  be  controlled  in  case  of  the  isotonic  and  NLR  stick 
is  the  stick  deflection,  while  the  stick  force  is  the  control  input  in  case  of  the  force 
stick  . 

The  stick  deflection  of  the  two  active  side  sticks  used  in  the  experiment  were 
proportional  to  the  roll  angle  •  or  the  roll  rate  I.  The  choice  of  the  roll  angle  ♦  will 

be  clear  from  the  example  given  in  chapter  2.  With  the  Feedback  of  the  roll  rate  ♦  to 
the  side  stick  position,  the  subject  feels  the  roll  rate  of  the  simulated  aircraft 
dynamics  via  the  stick  d i spl acemen t .  The  control  input  for  the  system  to  be  controlled 

was  the  stick  force  F  . 

a 
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The  gain  of  the  system  to  be  controlled  Hc*  K/'s  was  K  =  4  when  the  stick  deflection 
was  the  control  input  and  K  =  12  when  the  stick  force  was  the  control  input. 

The  forcing  function  consisted  of  thf  uo  of  ten  sinusoids  whose  frequency,  amplitude 
and  phase  are  given  in  Table  3-  The  standard  deviation  of  the  forcing  function  was  = 

1.87|>  degrees  . 

Two  subjects,  one  university  student  with  a  commercial  pilot  license  and  experience  on 
general  aviation  aircraft  and  one  university  staff  member,  qualified  jet  transport 
pilot,  volunteered  in  the  experiment.  Extensive  training  was  done*until  stable 
performance,  as  expressed  by  roll  angle  or  roll  angle  error  standard  deviation  was 
reached . 

All  ten  experimental  conditions,  five  side  sticks  and  two  control  tacks.  were  performed 
during  the  final  measurements.  Both  subjects  performed  the  disturbance  task,  one  subject 
the  target  following  task.  Five  replications  of  each  combination  (side  stick,  control 
task  and  subject)  were  recorded.  In  total  5x2x8  =  50  runs  for  the  disturbance  task  and 
5x1x5  =  25  runs  for  the  following  task  were  recorded  and  analysed. 

F.ach  run  lasted  110  seconds  of  which  the  last  8 2  seconds  were  recorded.  From  each  run 
the  standard  deviation  of  the  control  signal.  or  and  the  standard  deviation  of  the 

roll  angle  ♦  or  roll  angle  error  e#  were  computed.  In  addition  the  subject's  transfer 

function  H^ljw)  ) between  subject's  input  and  output  was  computed.  From  the  open  loop 

transfer  function  H  H  (jo)  the  crossover  frequency  u  and  the  phase  margin  ®  were 
pc  c  m 

determined . 


5  .  Results 


In  Fig.  12.  the  standard  deviations  of  the  roll  angle  ♦  or  the  roll  angle  error  et  and 

those  of  the  control  signal  F  or  s  arc  given  for  both  control  tasks  and  the  five 

a  a 

simulated  side  sticks.  For  both  control  tasks  with  the  passive  side  sticks  the  subject., 
have  the  best  tracking  performance  with  the  force  stick.  Active  side  sticks  show  a 
distinct  improvement  in  tracking  performance  relative  to  the  passive  side  sticks.  Better 
performance  also  corresponds  with  a  decrease  of  the  standard  deviation  of  the  stickforce 
(control  input).  Performance  improvement  with  the  active  sticks  in  the  disturbance  task 
could  be  expected  because  subjects  can  stabilize  the  controlled  system  by  simply  holding 
the  stick  fixed  in  the  mid  position. 

In  the  target  following  task  however,  the  subject  has  to  follow  the  forcing  function  1. 
Given  the  small  value  of  the  standard  deviation  of  the  roll  angle  error,  it  must  be 
conceived  that  the  feedback  of  the  roll  angle  or  r^ll  rate  in  the  position  of  th<*  side 
stick  distinctly  gives  the  subjects  extra  information  which  they  apparently  use  to 
improve  their  tracking  performance.  The  standard  deviation  of  the  roll  angle  for  both 
active  side  sticks  is  approximately  equal  to  the  perception  accuracy  found  in  perception 
experiments  with  the  same  artificial  horizon  display.  See  Ref.  11.  Hence  accuracy  of  the 
performance  obtained  seems  to  be  limited  by  the  perception  accuracy. 
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The  dynamic  behaviour  of  the  subjects  changed  only  slightly  due  to  the  different 
dynamics  of  the  passive  side  sticks,  as  shown  by  the  open  loop  describing  functions  in 

13.  As  could  be  expected  from  the  results  of  experiments  reported  in  the 

see  Ref.  1,  the  gain  and  phase  of  the  open  loop  describing  function  for  the 

force  stick  provides  the  highest  phase  margin  and  gain  margin. 

The  dynamic  behaviour  of  the  subjects  changed  considerably  when  changing  from  the 

the  active  side  sticks.  This  is  clearly  demonstrated  by  the  changes  in  gain 

These  changes  lead 

as  shown  in  Fig.  l4. 

angle  ♦ 


Fig. 
literature. 


passive 


and  phase  of  the  open  loop  describing  function  HpHr(ju>)  in  Fig.  13* 


to  an  increase  of  the  crossover  frequency  and/or  phase  margin  * 

The  large  difference  in  phase  margin  9  between  the  active  side  sticks  with  roll 


and  roll  rate  ♦  feedback  is  nut  surprising  bearing  in  mind  that  in  the  frequency  domain 
roll  rate  leads  roll  angle  by  90  degrees.  In  the  disturbance  task  the  phase  margin 
remains  approximately  equal  for  all  five  side  sticks,  while  the  crossover  frequency 
increases.  For  the  target  following  task  the  changes  in  the  crossover  frequency  and 
phase  margin  are  just  reversed.  This  phenomenon  is  also  found  due  to  the  influence  of 
cockpit  motion  cues  although  it  is  stronger  with  the  active  side  sticks  than  with 
motion.  See  Refs.  2,  9  and  13. 


6 .  Discussion  and  conclusions 


The  results  of  the  experiment  presented  in  the  present  paper  show  that  a  servo 
controlled  side  stick,  as  developed  at  the  Faculty  of  Aerospace  Engineering  of  the  Delft 
University  of  Technology,  provides  the  possibility  to  simulate  a  wide  variety  of  passive 
side  stick  dynamics.  This  offers  the  opportunity  to  evaluate  proposed  side  stick 
dynamics  for  future  Fly  by  Wire  aircraft. 

In  addition  it  has  been  shown  that,  when  using  the  servo  controlled  stick  as  an  active 
controller,  feedback  of  aircraft  state  or  output  variables  offers  a  possibility  for 
improvement  of  handling  characteristics  and  workload  reduc tion  which  is  worthwhile  to 
investigate  further. 

Looking  in  more  detail  at  the  results  of  the  experiment  it  is  clear  that  changes  in 
feedback,  from  passive  to  active,  via  the  neuromuscular  system  have  a  direct  influence 
on  subject's  control  behaviour.  This  is  basically  not  due  to  the  change  in  the  feedback 
path,  but  due  to  the  characteristics  of  the  neuromuscular  system,  a  "smart"  system  which 
may  be  used  more  effectively  in  aircraft  control.  More  fundamental  research  is  necessary 
to  understand  the  way  the  neuromuscular  system  interacts  with  the  information  processing 
che  pilot  performs  in  aircraft  control.  The  physiology  of  the  neuromuscular  system  is 
well  known  but  speed  and  influence  of  the  feedback  of  the  stickforce  and  stick  position 
on  the  perception  and  control  01  the  aircraft  state  is  still  unknown. 

As  shown  by  the  results  of  the  experiment  described  in  this  paper,  the  use  of  an  active 
side  stick  in  a  tracking  task  provides  the  subject  with  distinct  information  which  he 
can  not  obtain  with  his  visual  system  from  the  artificial  horizon  display.  This 
observation  is  not  sufficient  to  explain  why  proper  feedback  of  a  state  variable  in  the 
position  of  the  manipulator  helps  the  subject  to  improve  his  control. 

There  is  a  striking  similarity  of  the  influence  of  the  addition  of  real  motion  cues  to 
the  artificial  horizon  display,  see  Refs.  2  and  9.  and  the  change  from  a  passive  to  an 
active  manipulator  on  the  change  in  subjects  dynamic  behaviour  and  performance.  The  same 
changes  in  subject's  performance  and  transfer  function  and  corresponding  crossover 

frequency  u  and  phase  margin  9  were  found  for  both  the  disturbance  task  and  the 
c  m 

following  task  as  in  the  present  experiment,  see  Fig.  19.  I»  has  been  shown,  see  Ref.  2, 
that  in  case  of  the  addition  of  motion  cues  the  improvements  are  mainly  caused  by  a  more 
direct  and  faster  perception  of  rate,  enabling  subjects  to  generate  lead  and  or  to 
decrease  their  effective  time  delay.  In  the  normal  frequency  range  of  aircraft  movements 
the  output  of  the  vestibular  system  leads  the  rotational  rate  signal,  as  it  has  to  be 
perceived  from  the  artificial  horizon  or  the  outside  world,  by  approximately  1 90  msec. 
Given  t ho  increase  of  the  phase  angle  as  shown  in  Fig.  13  when  comparing  the  active  side 
sticks  with  the  force  stick,  a  tentative  conclusion  could  bo  that  the  change  in  control 
behaviour  of  the  subjects  between  the  use  of  the  passive  and  the  active  manipulators  is 
•aused  by  a  lead  of  the  neuromuscular  feedback  of  the  controlled  variable  relative  to 
*  h  e  visual  f  « o  d  b  a  c  k . 

Summarizing  the  results  of  the  tracking  experiment  as  described  in  this  paper  it  can  be 
'•one  ;  uded  that: 

-  a  servo  controlled  side  stick  is  an  ideal  tool  for  the  evaluation  of  proposed  passive 
side  stick  dynamics. 

-  active  side  sticks  (feedback  of  aircraft,  state  variables  i.i  the  stick  position)  offer 
the  possibility  of  improved  handling  cha r«c ter i s t i cs  and  workload  reduction  which  has 
to  be  investigated  further. 

‘  the  improved  tracking  performance  and  increased  lead  in  pilot's  describing  function 
due  to  the  active  side  stick  seems  to  be  a  result  of  the  dynamics  of  the  neuromuscular 
system  . 
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Table  1.  Details  of  the  position  servo. 


MOTOR 

piston  mass  m= 

pistonsurface  A  = 
maximum  stroke  S  = 
max .  piston 

velocity  y  = 
max.  force  (restricted)  F  = 
hydraulic  pressure  p  = 


0.495  kg 

0.15  10"  m 

0.06  m 

0.47  m / s 

100  N 

210  Bar 


t 


i 

l 


» 


CONTROL  VALVE 

Moog  series  30  type  235A 

r,  a  l.  u  1  <1 1  r.c(<.  u>#=  1050 


damping 
max. flow 


C  =  0.90 

Q  =  7-0  10 


rad  /  s 


POSITION  TRANSDUCER 

Hottinger  Baldwin  Messtechnik  L.V.D.T. 
type  W  50  K  (0.2) 

gain  K  =  120  V/m 


s 


The  Use  of  Integrated  Side-arm  Controllers  in  Helicopters 

J.M.Morqan  and  S . R . M . Sinclair 


27-1 


Flight  Research  Laboratory 
National  Research  Council  of  Canada 
Ottawa , Ontario ,  K1A  0R6 
Canada 


Summary 

This  paper  reviews  work  conducted  with  integrated  Side-Arm  (Sidestick)  con¬ 
trollers  in  a  variable  stability  helicopter  at  the  Flight  Research  Laboratory  of  the 
National  Research  Council  of  Canada.  The  investigations  have  covered  an  eight  year 
period  and  involved  the  use  of  three  different  types  of  controller.  The  advantages  and 
dis-advantages  of  integrated  controllers  are  discussed  and  an  "informed  opinion"  of 
their  applicability  is  presented.  Finally,  data  acquired  during  a  succession  of 
piloted  experiments,  indicating  that  Level  1  handling  qualities  are  achievable  with 
these  types  of  controller,  are  summarised. 


Symbols  (Used  in  the  Illustrations) 


BARE 
I  TRIM 
RD+IT 
RC 

RCAH 

ACAH 

RCHH 

ACRH 

LOW 

MOD 

HIGH 


Direct  drive  from  inceptor  to  actuator 
Integral  Trim  on  Pilot’s  Command,  direct  drive 
Light  Rate  Damping  Augmentation  plus  I  TRIM 
Rate  Command  (Very  high  level  of  Rate  Damping) 
Rate  Command,  Attitude  Hold 
Attitude  Command,  Attitude  Hold 
Rate  Command,  Heading  Hold  (Yaw  Axis) 
Acceleration  Command,  Rate  Hold  (Yaw  Axis) 

Low  Bandwidth  (0.75  to  1.5  rad/sec) 

Moderate  Bandwidth  (2.0  to  2.7  rad/sec) 

High  Bandwidth  (2.8  to  3.5  rad/sec) 


Introduction 

The  aviation  community  has,  over  the  past  two  decades,  become  more  and  more 
interested  in  the  high  technology  cockpit,  to  the  extent  that  exotic  electronic  dis¬ 
plays  are  becoming  commonplace,  while  the  term  "Glass  Cockpit"  has  definitely  entered 
the  vocabulary  of  the  industry.  The  same  rapid  advances  in  electronics  and  computer 
technology  have  permitted  the  augmentation  or  modification  of  aircraft  responses  to  an 
unprecedented  level,  even  to  the  automation  of  some  of  the  functions  traditionally 
assigned  to  the  human  pilot.  Research  conducted  at  the  Flight  research  Laboratory 
( FRL)  of  the  National  Aeronautical  Establishment  (NAE,  a  Division  of  the  National 
research  Council  of  Canada)  is  contributing  to  both  these  aspects  of  modern  aircraft 
design  specifically  as  they  apply  to  the  helicopter.  For  the  past  eight  years  the 
Laboratory  has  been  conducting  piloted  experiments  into  the  use  of  integrated  Side-Arm 
Controllers  (SAC)  using  the  Airborne  Simulator  (a  highly  modified  fly-by-wire  Bell 
205-A1,  illustrated  in  Figure  1  and  fully  described  in  Reference  1)  as  the  primary 
research  tool . 

This  paper  will  review  the  research  which  has  been  conducted  using  three  types  of 
SAr,  these  being  Isometric  Force  Sensing,  Limited  Compliance  Force  Sensing  and  Large 
Deflection  Position  Sensing  respectively.  These  controllers  (Figures  2a,  b  and  c) 
were  all  capable  of  providing  outputs  in  four  degrees  of  freedom  as  shown  in  Figure  3. 
Support  structure  for  the  controllers,  incorporating  arm  rests  were  attached  directly 
to  a  standard  Bell  205  seat  (Figure  4).  The  controllers  were  used  both  with  primitive 
(open  loop)  and  a  variety  of  closed-loop  active  control  systems. 

A  variety  of  controller  configurations  has  been  used,  from  the  simplest  in  which 
the  SAC  simply  replaced  the  conventional  cyclic  controller  to  the  fully  integrated 
four  function  application  in  which  the  SAC  was  the  only  inceptor  of  the  pilot's 
commands.  Fully  integrated  controllers  have  been  installed  for  ambidextrous  use  also. 


Justification 

When  the  decision  to  initiate  SAC  research  was  taken,  little  was  known  about  the 
practical  application  of  these  devices  in  helicopters.  There  did,  however,  appear  to 
be  considerable  advantages  to  be  gained  from  their  use  if  it  could  be  accomplished 

without  a  aignif leant  degradation  in  handling  qualities  and  if  the  prime  facie  dis¬ 
advantages  in  their  uae  could  be  overcome. 
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Ad van t ages 

Improved  Pilot  Efficiency 

Since  conventional  helicopter  controls  require  the  use  of  all  limbs,  ancill¬ 
ary  tasks  must  be  performed  on  a  stolen-time  basis  by  abandoning  a  primary 
control,  normally  the  collective  lever.  In  some  flight  phases  this  can  be  done 
with  impunity,  at  oth.r  times  it  is  inappropriate  if  not  dangerous  and  subsidiary 
tasks  must  be  delayed.  Integrating  primary  control  functions  onto  a  single 
device  such  that  one  arm  is  freed  indefinitely  for  other  uses  has  the  potential 
to  reduce  workload  and  relieve  stress  in  the  cockpit.  The  provision  of  two 
controllers  for  ambidextrous  use  can  free  either  hand  for  alternate  duties,  not 
only  assisting  the  pilot,  but  also  freeing  the  designer  to  produce  ergonomically 
more  attractive  cockpits  than  is  presently  possible.  This  is,  perhaps,  the  most 
compelling  single  argument  for  the  use  of  integrated  SAC,  always  assuming  that 
vertical  axis  control  would  be  the  first  function  to  be  integrated  with  pitch  and 
roll. 

Additional  Usable  Cockpit  Space 

Upon  the  installation  of  SAC  the  volume  previously  swept  by  the  cyclic  stick 
is  released  for  alternative  use.  Since  this  is  centrally  located  and  within  easy 
reach  and  sight  of  the  pilot,  it  must  be  considered  a  prime  region.  Addition¬ 
ally,  existing  areas  not  presently  attractive  because  of  visual  obscuration  by 
the  pilot's  arm  and  cyclic  stick  or  because  of  inaccessibility  to  the  left  hand 
also  become  usefully  available. 

Simplified  Control  Grips 

Current  helicopters  carry  a  plethora  of  ancillary  controls  on  the  primary 
control  grips  to  accommodate  the  fact  that  the  pilot  may  not  always  abandon  a 
controller  at  will  and  must  therefore  have  any  essential  secondary  controllers 
placed  so  that  they  can  be  operated  without  removing  the  hands.  This  constraint 
detracts  from  the  desireable  practice  of  the  functional  and  intuitive  grouping  of 
controls  and  displays.  The  restriction  evaporates  with  SAC  installations;  in 
fact,  the  opposite  approach  is  indicated  since  informal  investigations  show  that 
there  are  difficulties  in  placing  ancillary  controls  on  a  multi-function  SAC  in 
such  a  way  that  they  can  be  operated  without  degrading  primary  control  activity. 

Reduced  Fatigue  and  Improved  Pilot  Health 

The  rapid  onset  of  fatigue  compared  with  that  experienced  by  fixed  wing 
pilots  and  the  prevalence  of  lower  back  medical  problems  amongst  helicopter 
pilots  are  well  recognised  phenomena.  Amongst  the  quoted  contributory  factors  of 
the  former  is  the  inability  of  the  pilot,  when  flying  current  machines,  to  make 
those  body  position  changes  useful  in  reducing  muscle  tension  and  easing  dis¬ 
comfort.  The  latter  stems  largely  from  the  'helicopter  crouch'  a  poorly  support¬ 
ed,  curved  spine  sitting  posture  frequently  adopted  by  helicopter  pilots  as  a 
necessity  in  handling  the  controls  and  which  they  have  to  maintain  in  a  very 
vibratory  environment.  The  upright  seating  and  upper  body  support  provided  by 
the  armrests  implicit  in  SAC  installations  eliminates  the  hunched  position  and 
permits  tension  relieving  body  movements. 

Reduced  Inter-action  with  Active  Control  Systems 

Experiences  with  high  gain  active  control  systems  at  the  FRL  has  indicated 
the  existence  of  a  pernicious  problem  in  the  form  of  a  relatively  rare  type  of 
Pilot  Induced  Oscillation  (PIO) .  This  is  not  the  classic  PIO  in  which  pilot- 
induced  lag  interacts  with  the  vehicle  dynamics  to  cause  periodic  closed-loop 
instability  but  is  due  to  uncontrollable  bio-mechanical-inertial  feed-back. 
Aircraft  motion'*  feed  back  into  the  control  loops  via  the  seismic  sensor  formed 
by  the  pilots  upper  body,  arm  and  cyclic  stick,  causing,  under  some  conditions, 
outer  loop  instability.  This  can  result  in  gross  and  rapidly  divergent  aircraft 
motions  or  can  excite  unusual  aircraft  structural  modes,  usually  at  frequencies 
higher  than  those  associated  with  the  classic  PIO.  These  effects  are  still 
present  with  SAU,  but  are  of  much  higher  frequency  still.  Not  only  do  the  devices 
themselves  have  a  higher  natural  frequency  than  the  usual  cyclic  stick,  but  the 
armrests  tend  to  force  a  node  at  the  pilot's  fore-arm.  This  effectively  isolates 
the  upper  body  from  the  feed-back  system,  reducing  the  effective  seismic  mass  and 
further  raising  the  system  resonant  frequency.  Generally  the  frequency  of  oscill¬ 
ation  with  SAC  is  well  above  the  pilot’s  bandwidth  and  the  tendencies  can  be  con¬ 
trolled  by  relatively  simple  conditioning  of  the  SAC  signals.  To  control  the 
condition  when  using  conventional  controls  it  has  been  found  necessary  to  simulate 
a  stick  with  very  high  values  of  viscous  damping  and  inertia,  characteristics 
generally  detrimental  to  the  handling  qualities  of  the  machine. 


Disadvantages 


Manual  Resolution 

Typically  in  present  helicopters,  control  throws  are  in  the  order  of  plus 
and  minus  10  to  15  cm  for  the  cyclic  stick  and  25  to  30  cm  for  the  collective 
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lever;. the  human  pilot  is  capable  of  making  consistent  changes  in  the  position  of 
such  controls  to  within  a  few  millimetres.  Inputs  of  this  level  are  frequently 
used  in  the  stabilisation  task,  often  as  the  open  loop  first  response  to  external 
disturbances.  The  largest  full  scale  displacement  at  mid  hand  position  amongst 
the  side-arm  controllers  evaluated  is  approximately  2.5  cm  and  therefore  an 
input  at  the  lowest  possible  resolution  is  a  much  larger  proportion  of  the  total 
control  throw  than  is  the  case  with  traditional  controllers.  With  isometric  or 
low  compliance  force  sensing  devices  yet  more  cues  are  lost,  since  the  human 
being  is  far  less  adept  at  estimating  the  force  he  is  applying  than  the  skeletal 
position  he  is  in.  Moreover  the  body  tends  to  wash  out  the  tactile  sensation 
from  a  sustained  force  causing  a  tendency  to  increase  the  applied  force  with  time 
in  the  absence  of  other  cues.  Pilots  appear  to  compensate  for  both  the  latter 
effect  and  the  loss  of  good  positional  feed-back  cues  by  using  pulsed  control 
strategies  for  very  small  inputs. 

Controller/Controlled  Element  Relationship 

In  current  unaugmented  helicopters,  there  is  a  fixed  relationship  between 
the  controller  and  the  controlled  element  (actuator) ,  from  which  the  pilot  gains 
a  great  deal  of  information.  In  the  cyclic  stick  he  has  a  direct  analogue  of  the 
orientation  of  the  thrust  vector,  essential  information  during  some  flight  phases, 
while  pedal  position  provides  him  with  information  regarding  the  ambient  wind  or 
his  lateral  velocity.  From  all  controls  he  obtains  an  immediate  indication  of 
incipient  control  saturation,  a  very  real  threat  to  the  helicopter  pilot.  This 
immediate  information  is  irrevocably  lost  on  conversion  to  SAC,  but  that  may  not 
be  serious.  It  is  most  unlikely  that  SAC  would  ever  be  considered  for  a  primitive 
machine,  while  once  closed-loop  or  response  command  control  systems  are  used  the 
direct  relationships  cease  to  exist.  Also,  with  well  designed  control  systems 
some  of  the  information  may  no  longer  prove  to  be  essential1 . 

Inter  Axis  Cross  Talk  (Cross  Coupling) 

All  the  side-arm  controllers  used  at  FRL  have  exhibited  some  degree  of  cross 
talk,  the  most  common  being  pitch  to  vertical  and  vertical  to  pitch  in  the  force 
sensing  units  and  vertical  to  roll  in  the  early  models  of  the  displacement  controller. 
The  characteristics  in  the  force  sensing  devices  were  greatly  reduced  by  a  re-deign  of 
the  grip  (Reference  3  and  Figure  5)  and  by  a  reduction  in  ball  size  in  association 
with  modified  grip  geometry  for  the  displacement  controller.  Both  types  of  SAC  have 
low  level  residual  cross  talk,  but  this  is  not  obtrusive  and  does  not  produce  any 
adverse  commentary  from  evaluators. 

Historical  Summary 

The  various  investigations  conducted  into  SAC  at  the  Flight  Research  Laboratory 
have  generally  been  triggered  by  much  larger  programs  initiated  by  other  agencies.  In 

late  1979  FRL  was  approached  by  the  Sikorsky  Aircraft  Division  of  United  Technologies 

with  a  request  that  it  conduct  a  feasibility  study  into  the  operation  of  a  four  degrees 
of  freedom,  isometric,  force-sensing  SAC  in  the  Airborne  Simulate-..  A  joint  research 
project  with  Sikorsky  was  undertaken  and  completed  in  mid  1980,  following  a  compre¬ 
hensive  development  period  and  a  systematic  evaluation  by  test  pilots  from  both  FRL 
and  the  company.  The  results  (Reference  2'  were  not  published  until  some  twelve 
months  later  due  to  a  confidentiality  agreement  between  FRL  and  Sikorsky. 

Following  this,  a  series  of  in-house  experiments  was  conducted,  inspired  by 

research  being  conducted  both  at  Boeing  Vertol  in  Philadelphia  and  at  NASA (Ames)  in 

support  of  the  US  Army  ADOCS  (Advanced  Digital  Optical  Control  Systems)  project.  The 

FRL  had  a  close  but  informal  link  with  this  project,  a  NAE  pilot  taking  part  in  many 
of  the  early  simulations  (References  4  and  5) .  Observations  made  at  these  suggested 
that  for  investigations  in  low  speed  visual  flight,  ground  simulation  data  should, 

where  possible,  be  validated  in  the  air.  By  1985  this  had  given  rise  to  the  work 

published  in  Reference  6. 

For  the  past  two  years  FRL  has  been  involved  as  a  co-operative  partner  (its 

activities  being  supported  and  partially  funded  by  the  Canadian  Department  of  Defence) , 
in  the  US  Army  sponsored  MIL-8501-A  update  project.  This  generated  additional  SAC 
research,  since  it  was  felt  that  specifications  to  which  a  future  generation  of  milit¬ 
ary  helicopters  were  to  be  designed  should  cater  for  the  possible  use  of  SAC.  Detailed 
results  of  part  of  this  work  appear  in  Reference  10. 

Finally,  CAE  Ltd  of  Montreal  wished  to  develop  a  displacement  SAC  for  helicopter 
use  as  an  offshoot  of  their  work  on  multi-axis  inceptors  for  space  vehicle  applic¬ 
ations.  Another  joint  research  project  initiated  a  period  of  iterative  development. 


1  Flying  attitude  command  systems  in  the  Airborne  Simulator,  off  level  landing 
became  a  single  input  task.  From  a  stable  hover  one  simply  had  to  lower  the  collective 
lever  and  as  the  aircraft  made  ground  contact  and  rolled  onto  the  slope  the  attitude 
loops  made  the  required  inputs  to  position  the  lift  vector  in  the  correct  direction 
and  by  the  correct  amount. 
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with  successive  engineering  models  of  a  four-function  displacement  SAC  being  evaluated 
in  the  Airborne  Simulator.  While  the  development  aspect  of  this  program  ended  in  late 
1936.  the  final  model  remains  available  to  FRL  for  further  generic  research.  Data 
from  this  activity  has  been  published  in  References  7  to  9 . 

The  extended  series  of  formal  investigations  was  supplemented  throughout  by 
familiarisation  and  demonstration  periods  for  a  wide  range  of  interested  groups.  SAC 
systems  have  been  flown  and  evaluated  by  helicopter  manufacturers  (Sikorsky,  Bell, 
Boeing,  Hughes,  MacDonald-Douglas  and  Westland  Helicopters),  NASA,  the  RAE,  DFVLR , 
DND ,  US  Army  and  US  Navy.  Whenever  possible  these  sessions  were  used  to  acquire 
further  HQR  data  and  some  of  these,  taken  in  a  recent  US  Army  (AEFA)  and  NASA(Ames) 
evaluation,  are  presented  in  this  paper. 

Summary  of  Experiments 

It  is  always  a  problem  when  researching  radically  new  technologies  to  determine 
the  best  course  of  investigation  with  the  limited  resources  available.  Each  SAC 
experiment  raised  further  questions,  or  indicated  new  facets  for  study.  Despite  this, 
SAC  research  at  FRL  has  followed  a  logical  path;  the  original  feasibility  study  con¬ 
centrated  on  applications  in  the  primitive  control  system  environment,  while  sub¬ 
sequent  investigations  progressed  to  the  use  of  active  control  systems.  Rate 
Command/Attitude  Hold  (RCAH)  and  Attitude  Command/Attitude  Hold  (ACAH)  systems  have 
been  flown  in  pitch  and  roll.  Acceleration  Command/Rate  Hold  ( ACRH)  and  Rate 
Com:  ^nd/Heading  Hold  (RCHH)  in  yaw. 


Discussion  and  Summary  of  Findings 


Discussion 

Pilot  Acceptance.  In  discussing  the  results  achieved  in  such  a  long  program,  general¬ 
ities  will  be  the  rule,  also,  results  based  on  Cooper-Harper  ratings  can  never  tell 
the  entire  story  and  in  particular  they  do  not  address  the  issue  of  pilot  acceptance. 
In  verbal  debriefings  and  informal  discussions  with  evaluators,  it  has  become  apparent 
that  there  exists,  amongst  a  small  but  not  insignificant  proportion  of  them,  a  tendency 
to  reject  SAC  on  emotional  rather  than  technical  grounds.  This  is  by  no  means  sur¬ 
prising  when  one  considers  that  they  are  highly  experienced  pilots,  heavily  conditioned 
to  conventional  machines  and  that  they  generally  received  no  more  than  two  hours 
training  on  SAC  prior  to  evaluation2.  Despite  this,  such  pilots  would  frequently 

assign  Level  1  HQR  to  the  systems  even  while  expressing  a  dislike  for  or  lack  of 
comfort  with  them.  This  is  considered  significant  and  it  is  expected  that  the 
antipathy  towards  SAC  would  fade  with  increased  exposure. 

A  Personal  Note.  This  section  represents  a  radical  departure  from  tradition  and  from 
accepted  practice  for  technical  presentation  in  that  it  presents  a  personal  view. 

"  Having  been  intimately  involved  in  the  Side-Arm  Controller  program  at  the  NAE 
from  the  very  start,  having  flown  in  all  of  the  programs  both  as  development  pilot  and 
evaluator  and  having  created  most  of  the  control  system  software,  I  feel  that  I  have  a 
unique  viewpoint  on  these  systems.  I  feel  also  that  this  is  justified  as  a  counter¬ 
balance  to  some  of  the  adverse  comments  that  one  hears,  I  acknowledge,  nevertheless, 
that  this  is  just  one  pilot's  view. 

I  have  now  acquired  over  250  hours  of  actual  SAC  flight  time,  have  flown  a  similar 
amount  as  safety  pilot  observing  others  and  have  flown  a  number  of  ground  based  SAC 
simulations.  Now,  even  in  projects  unrelated  to  SAC,  I  usually  employ  them  for  the 
development  phase  as  a  matter  of  preference.  I  find  the  improved  comfort  and  the 
ability  to  interact  with  a  computer  system  when  actively  flying  to  be  great  benefits, 
while  I  have  no  more  consideration  as  to  how  or  whether  I  should  perform  a  required 
manoeuvre  than  I  do  with  conventional  controls. 

SAC  have  now  been  experienced,  briefly,  by  quite  a  large  number  of  pilots,  very 
few  of  whom  have  ever  acquired  more  than  a  handful  of  hours  in  actual  flight.  More¬ 
over,  in  the  typical  handling  qualities  experiment  they  will  have  been  exposed  to  a 

range  of  control  systems  of  varying  response  types  and  quality,  good  and  bad;  this  in 
about  the  same  number  of  flight  hours  the  military  typically  allocates  to  cross  train 
a  pilot  from  one  type  to  another.  It  is  to  be  expected  that  they  would  come  away  from 
the  experience  with,  at  best,  a  certain  ambivalence  towards  integrated  controllers. 

It  is  my  unequivocal  opinion  that  Integrated  Side-Arm  Controllers  are  a  viable 
and  rational  approach  to  interfacing  the  pilot  with  his  machine.  In  no  way  do  they 
detract  from  his  capability  to  control  the  aircraft,  nor  do  they  demand  any  unusual  or 
excessive  skill:  Integrated  Controllers  do  not  reduce  the  usaole  normal  flight 
envelope.  A  certain  measure  of  pilot  assistance  is  required,  but  no  more  than  is 
currently  considered  necessary  for  future  helicopters  in  their  envisioned  tasks  and 
roles  . 


2  It  has  been  found  that  two  hours  training  or  familiarisation  is  adequate  for 
the  great  majority  of  pilots  prior  to  evaluating  SAC  tasks,  with  a  significant  pro¬ 
portion  signifying  that  they  feel  themselves  to  be  sufficiently  capable  with  the 
system  to  commence  evaluation  before  the  end  of  this  period. 


My  experiences  have  led  me  to  believe  firmly  that  many  of  the  misgivings  felt 
about  SAC  are  due  to  lack  of  experience.  Overall  workload  does  not,  I  feel,  increase 
with  well  designed  integrated  controllers  mated  with  well  designed  control  systems, 
though  it  does  seem  to  transfer  between  the  axes.  Many  of  the  adverse  comments  heard 
regarding  vertical  control  with  Side-Arms  stem  not  from  intrinsic  difficulties  in  the 
task,  but  rather  because  the  workload  in  that  channel  is  higher  in  proportion  to  that 
in  the  other  axes  than  is  the  case  with  conventional  inceptors.  Evaluators,  largely 
because  of  their  training,  tend  to  focus  on  difficulty  rather  than  ease. 

Finally,  my  comfort  with  and  complete  acceptance  of  fully  integrated  SAC  are  not 
recent  phenomena,  they  have  been  with  me  sufficiently  long  that  I  cannot  remember  the 
early  discomforts.  This  is  the  logical  extension  of  the  pattern  of  rapid  pilot  adapt¬ 
ation  which  we  have  observed  many  times  over  in  the  great  majority  of  pilots,  even 
those  who  have  shown  a  marked  bias  against  integrated  controllers.*’  (Morgan) 

Summary 

HQR  Level 

From  all  the  experimental  data  gathered  so  far,  one  fact  emerges  consistent¬ 
ly:  it  is  possible  to  achieve  Level  1  HQR  using  a  fully  integrated  SAC  with  very 
little  augmentation  of  the  basic  aircraft  responses.  This  has  been  a  repeatable 
observation  in  data  provided  by  a  wide  variety  of  pilots  using  all  three  con¬ 
troller  types  in  a  wide  range  of  tasks.  This  finding  is  illustrated  in  Figure  €• 
which  summarises  all  available  data  for  fully  integrated  configurations,  while 
the  unaugr.ented  aircraft,  with  the  SAC  driving  the  actuators  directly  via  a 
simple  gain  is  shown  as  a  borderline  Level  2  vehicle,  the  addition  of  such  a 
simple  pilot  assist  as  an  integral  or  follow-up  trim  brings  it  to  a  high  Level  1 
while  the  further  addition  of  a  small  amount  of  rate  damping  augmentation  ir. 
pitch,  roll  and  yaw  makes  the  aircraft  a  definite  Level  1  machine. 

Level  of  integration 

If  the  level  of  controller  integration  is  reduced  by  retaining  the  yaw 
pedals  the  results  of  Figure  7  obtain.  In  this  case  even  the  unaugmented  but 
self  trimming  vehicle  is  firmly  Level  1.  In  view  of  this  observation  there  would 
appear  to  be  no  pressing  argument  for  the  use  of  levels  of  integration  greater 
than  this  from  a  piloting  point  of  view  (though  this  does  not  preclude  other 
considerations  from  making  full  integration  an  attractive  proposition) .  Revert¬ 
ing  to  yaw  control  via  the  feet  still  achieves  one  of  the  main  objectives  of 
controller  integration , it  releases  one  of  the  arcs  for  ancillary  tasks  yet  it 
dois  not  make  as  many  demands  on  the  pilot’s  neuromuscular  control  system  as  does 
th_*  fully  integrated  configuration.  This  is  an  important  step  ir.  the  humanising 
of  the  helicopter  cockpit. 

Control  System  Sophistication 

Automation  of  one  or  more  of  the  stabilisation  tasks  normally  carried  out  by 
the  human  pilot  can  have  a  very  beneficial  effect  on  overall  vehicle  handling 
qualities.  This  is  illustrated  in  Figure  8,  taken  from  Reference  6.  Here  a 
lightly  rate  damped  aircraft  in  pitch  roll  and  yaw  was  brought  to  an  overall 
Level  1  by  the  implementation  of  either  of  two  advanced  control  systems  ■»  n  the 
yaw  axis  only.  Rate  Comir.and/Heading  Hold  (RCKK)  or  Acceleration  Command/Rate  Hold1 
(ACRH) .  This  result  was  confirmed  in  later  experiments,  when  the  provision  of 
RCAH  and  ACAH  systems  in  pitch  and  roll  produced  good  Level  1  HQR. 

Control  System  Characteristics 

One  of  the  8501  Update  investigations  was  concerned  with  the  effects  of 
control  system  bandwidth  on  HQR  for  Rate  Command, RCAH  and  ACAH  systems  in  pitch 
and  roll.  Data  was  taken  both  with  conventional  controls  and  a  displacement 
fully  integrated  SAC.  Close  examination  of  the  results  presented  in  Reference  10 
and  re-plotted  as  Figure  9  indicates  that  pilots  were  more  tolerant  of  low  band¬ 
width  systems  when  using  the  SAC  than  when  handling  traditional  controls.  This 
observation  may  have  been  influenced  by  the  method  used  to  measure  bandwidth 
(Computer  generated  frequency  sweeps)  and  will  be  subject  to  further  investi¬ 
gations. 


Concluding  Remarks 

The  Flight  Research  Laboratory  now  is  the  repository  of  some  eight  years  of 
experience  in  the  operation  of  a  helicopter  in  all  regimes  of  flight  with  fully  inte¬ 
grated  side-arm  controllers  in  place  of  the  conventional  inceptors.  This  experience, 
together  with  informal  investigations  indicate  that  Integrated  Side-Arm  Controllers 
are  a  viable  alternative  to  the  traditional  control  levers  and  pedals  for  helicopter 
use  and  demand  only  low  levels  of  vehicle  response  augmentation,  to  produce  handling 
qualities  equal  to  those  achievable  conventionally.  They  do  not  limit  the  pilot's 
ability  to  control  his  machine  nor  limit  the  normal  flight  envelope.  It  is 


1  The  detailed  results  of  this  experiment,  showing  approximately  even  preference 
for  either  RCHH  or  ACRH  systems  was  quite  different  form  a  similar  experiment  conducted 
in  ground  based  simulators  which  indicated  very  poor  HQR  for  the  ACRH  system  under  all 
conditions . 


acknowledged  that  there  is  still  a  great  deal  of  work  to  be  done  in  this  area  to  make 
such  devices  acceptable  to  the  helicopter  community  at  large  and  it  is  the  intention 
of  the  laboratory  to  continue  with  this  research  and  to  expand  our  understanding  of 
these  radically  new  inceptors . 
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FIG.  1:  NAE  AIRBORNE  SIMULATOR 


(a)  Isometric 


(b)  Limited  Compliance 


(c)  Displacement 


FIG.  2:  THE  SIDE  ARM  CONTROLLERS 


FIG.  3:  CONTROLLER  SENSING  AXES 


FIG.  4:  BELL  205  SEAT  WITH  INTEGRATED  SAC 


(a)  Original 


(b)  Modified 


FIG.  5:  MODIFIED  HAND  GRIP 
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FIG.  8:  EFFECTS  OF  CONTROL  SYSTEM  AUTOMATION 
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FIG.  9:  ILLUSTRATION  OF  THE  EFFECTS  OF  CONTROL  SYSTEM  BANDWIDTH  ON 
CONVENTIONAL  CONTROLS  AND  SIDE  ARM  CONTROLLERS 
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ABSTRACT 

ft  digital/optical  flight  control  system  has  been  implemented  on  a  UH-bO  Black  Hawk 
helicopter  to  determine  flight  control  system  requirements  for  Nap-of-the-Earth  (NOE) 
flight.  Small-displacement  side-stick  controllers  with  unique  force  trim  positions  were 
an  integral  part  of  the  control  system  design.  Controller  configurations  could  be 
readily  altered  from  a  fully  integrated  four-axis  side-stick  controller  to  separated 
controller  configurations  including  (3+1 )Collective  and  (2+1+1).  Control  laws  were 
implemented  with  a  model  following  architecture  that  facilitates  variations  of  control 
response  characteristics. 

The  Automatic  Flight  Control  System  (AFCS)  was  designed  to  provide  level  1  handling 
qualities  and  the  Primary  Flight  Control  System  (PFCS!  was  implemented  to  achieve  level 
2  handling  qualities.  The  interrelational  effects  of  controller  configuration  and 
piloting  task  on  handling  qualities  was  investigated.  Handling  qualities  were  evaluated 
using  precision  hover  and  low-speed  tasks  typical  of  NOE  flight  as  well  as  tasks 
performed  at  airspeeds  from  80  to  120  knots.  Piloted  results  are  presented  with 
recommendations  for  future  systems  utilizing  small-displacement  side-stick  controllers 
in  their  design. 


NOTATION 

AATD  -  Aviation  Applied  Technology  Directorate 

ACC/AFCS  -  Advanced  Control  Concepts/Advanced  Flight  Control  System 

ADOCS  -  Advanced  Digital  Optical  Control  system 

AFCS  -  Automatic  Flight  Control  System 

AGL  -  Above  Ground  Level 

BUCS  -  Back-up  Control  System 

DOCS  -  Digital/Optical  Control  System 

FCP  -  Flight  Control  Processor 

FCS  -  Flight  Control  System 

HQRS  -  Handling  Quality  Ratings 

IGE  -  In  Ground  Effect 

LHX  -  Light  Helicopter  Experimental 

MSSP  -  Mode  Select  Status  Panel 

NOE  -  Nap  of  the  Earth 

OGE  -  Out  of  Ground  Effect 

PCDU  -  Parameter  Change  and  Display  Unit 

PFCS  -  Primary  Flight  Control  System 

PIO  -  Pilot  Induced  Oscillation 

SCAT  -  Scout/Attack 

SSC  -  Side-stick  Controller 

VMC  -  Visual  Meteorological  Conditions 
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INTRODUCTION 

The  Advanced  Digital/Optical  Control  System  (ADOCS)  Demonstrator  program  was  initiated 
in  1980  to  develop  the  technologies  required  to  implement  an  ADOCS  on  the  next 
generation  of  scout/attack  (SCAT)  rotorcraft.  Distinct  technology  elements  of  the  ADOCS 
design  include  fiber  optic  links  for  communication  between  system  elements,  multi-axis 
side-stick  controllers  (SSC),  and  digital  flight  control  laws  developed  specifically  for 
the  SCAT  mission  with  emphasis  on  Nap-of-the-Earth  (NOE)  flight. 

The  primary  objective  of  the  ADOCS  Program  was  to  demonstrate  feasibility  and  evaluate 
performance  of  a  Digital/Optical  Control  System  (DOCS).  Program  goals  were  to  achieve 
Level  1  Handling  Quality  Ratings  (HQRS ) 1  for  augmented  flight,  and  Level  2  HQRS  for 
flight  without  stability  augmentation.  More  specifically,  the  DOCS  was  designed  to 
provide  unaugmented  handling  qualities  equal  to  those  of  the  production  unaugmented 
mechanical  flight  control  system  (PCS),  and  augmented  stability  and  control 
characteristics  which  demonstrate  improved  handling  qualities  and  reduced  pilot  workload 
for  the  SCAT  mission  tasks. 

Flight  testing  of  the  "Light  Hawk",  a  modified  JUH-60A  (Fig.  1),  began  on  November  7, 
1985  with  the  first  fly-by-light  maneuvering  performed  using  the  PFCS.  The  flight  test 
program  was  carried  out  in  two  phases  from  Nov.  '85  to  the  present.  The  first  phase  was 
directed  toward  development  of  the  Primary  Flight  Control  System  (PFCS);  the  flight 
critical  link  between  the  pilot  and  the  swashplate  actuators.  Subsequent  testing,  which 
started  in  January  1986,  concentrated  on  optimization  of  the  Automatic  Flight  Control 
System  (AFCS)  which  included  refinement  of  both  the  stabilization  loops  and  the  command/ 
response  characteristics  based  on  flight  evaluation  results.  This  paper  briefly 
describes  various  system  components  comprising  the  ADOCS  and  documents  the  results  of 
piloted  handling  qualities  flight  evaluations  of  the  system. 

SYSTEM  DESCRIPTION 

Elements  of  the  ADOCS  design  most  influential  in  affecting  the  aircraft  handling 
qualities  are  summarized  in  the  following  paragraphs.  Additional  details  of  the  system 
design  including  system  hardware  and  testing  can  be  found  in  Ref.  2. 

SIDE-STICK  CONTROLLERS  (SSC) 

Three  side-stick  controllers  were  installed  in  the  ADOCS  Demonstrator  aircraft  as 
indicated  in  Fig,  2.  A  4-axis  controller  is  located  on  the  right-hand  side  of  the  DOCS 
pilot  seat,  while  a  single-axis  collective  controller  is  provided  on  the  left-hand  side. 
The  DOCS  pilot  station  is  also  equipped  with  small-displacement  force  pedals.  A  second 
4-axis  controller  is  installed  on  the  right-hand  side  of  the  DOCS  observer  station 
(located  in  the  rear  cabin  area)  solely  for  evaluating  the  control  laws  for  transfer  of 
control  between  the  DOCS  pilot  and  copilot  (and  vice-versa). 

Three  controller  configurations  were  evaluated  on  the  Demonstrator  as  shown  in  Fig.  3. 
Initial  simulation  results  obtained  during  the  ACC/AFCS  program3  recommended  separation 
of  the  collective  controller  for  high  workload  tasks.  Isolation  of  the  collective 
controller,  as  in  both  the  (3+1 )Collective  and  (2+1+1)  configurations,  resulted  in 
improved  pilot  ratings  compared  to  the  (4+0)  configuration. 

Force/displacement  characteristics  of  the  ADOCS  4-axis  side-stick  controller  are 
presented  in  Table  1.  These  characteristics  were  determined  through  a  series  of  piloted 
simulations  reported  in  Ref.  3.  Characteristics  of  the  flight  hardware  met  recommended 
values  with  the  exception  of  the  breakout  forces  which  could  not  be  reduced  to  desired 
levels  because  of  mechanical  limitations  of  the  transducers.  The  friction  levels  in  the 
transducers  were  reduced  to  levels  which  did  not  degrade  handling  qualities.  Pilot 
comments  obtained  during  evaluation  flights  indicate  that  the  force/displacement 
characteristics  of  the  ADOCS  controllers  were  acceptable  for  the  tasks  performed  with 
the  possible  exception  of  the  yaw  axis.  Some  pilots  felt  that  the  yaw  axis  force/ 
displacement  gradient  was  too  high  for  NOE  tasks . 

PRIMARY  FLIGHT  CONTROL  SYSTEM  (PFCS) 

The  PFCS  (Fig.  4)  provides  the  only  link  between  the  DOCS  pilot  and  the  control 
actuators  and  is  designed  as  a  flight  critical  element  of  the  FCS.  A  complete 
description  of  each  PFCS  element  is  provided  in  Ref.  4.  The  following  is  a  description 
of  those  PFCS  elements  which  were  modified  during  flight  testing  including:  control 
filtering,  dynamic  shaping,  and  automatic  trim  follow-up. 

Digital  notch  filters  were  provided  in  the  PFCS  in  all  axes  to  eliminate  the  feedback  of 
structural  vibrations  into  the  control  paths.  Flight  test  data  were  analyzed  to  select 
the  filter  frequency  requirements.  Second  order  algorithms  were  selected  for  all  notch 
filters. 

Dynamic  shaping  (Fig.  5)  was  included  in  the  PFCS  control  path  to  provide  control 
quickening  because  the  basic  response  characteristics  of  the  unaugmented  UH-60A  are 
sluggish,  particularly  in  the  pitch  and  yaw  axes.  The  dynamic  shaping  was  designed  to 
alter  the  short  period  basic  aircraft  response  by  effectively  canceling  inherent  short 
period  roots  and  substituting  poles  which  provide  a  more  desirable  response 
characteristic.  Basic  response  characteristics  of  the  UH-60  in  the  roll  and  vertical 
axes  were  judged  acceptable  without  modification  due  to  the  inherent  damping  of  the 
aircraft. 
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Automatic  trim  follow-up  algorithms  are  provided  in  each  axis  to  eliminate  requirements 
for  the  pilot  to  hold  steady-state  control  trim  forces.  As  shown  in  Fig.  5,  a 
non-linear  digital  integration  path  is  used  to  store  trim  requirements.  Actuator 
positions  are  demixed  to  provide  equivalent  cockpit  control  displacement  used  as  the 
input  to  the  trimming  algorithm.  In  this  manner,  the  most  current  rotor  control 
position  is  used  in  the  trimming  loop.  Automatic  trimming  is  disabled  by  logic  when  the 
controller  is  returned  to  its  unique  neutral  position  to  eliminate  any  long  term  drift 
which  may  occur. 

AUTOMATIC  FLIGHT  CONTROL  SYSTEM  (AFCS) 

Control  Law  Architecture 


The  ADOCS  control  laws  employ  a  modified  explicit  model  following  concept5  as  shown  in 
Fig.  6.  The  PFCS  feed- forward  path  transfer  function  D(s)/P(s)  is  intended  to  cancel 
aircraft  inherent  short  period  modes  while  substituting  roots  of  a  desired  response. 
Ideally,  even  without  an  AFCS,  the  aircraft  response  to  a  pilot  command  input  would 
reflect  the  dynamics  in  D(s)  and  not  in  P(s).  The  AFCS  command  model  generates 
predicted  aircraft  states  based  on  the  dynamics  contained  in  D(s).  State  errors  (the 
difference  between  the  expected  state  and  the  sensed  state)  are  formed  and  passed 
through  appropriate  stabilization  gains.  Any  state  errors  existing  in  the  AFCS  are 
due  to  inexact  cancellation  of  the  aircraft  dynamics  in  the  PFCS  and  external  inputs 
such  as  gust  upsets.  The  total  AFCS  command  is  passed  through  a  port  limit  into  the 
PFCS.  Since  the  model  following  architecture  provides  a  cancellation  of  closed  loop 
aircraft  dynamics,  feedback  design  can  be  performed  independently  of  feed- forward 
design,  thus  greatly  reducing  the  optimization  task. 

Several  issues  as  reported  by  Chen6  have  not  been  included  in  the  above  simplified 
presentation  of  the  model  following  concept.  Significant  delay  inducing  components 
between  the  rotor  command  and  the  sensed  aircraft  states  need  to  be  considered  in  the 
analysis.  These  components  include:  DOCS  driver  actuators,  UH-60  upper  boost  actuators, 
aircraft  rotor  dynamics,  and  sensor  dynamics.  Model  following  theory  would  include 
these  dynamic  elements  as  part  of  the  aircraft  model  [P(s)J.  However,  analytical 
methods  result  in  a  PFCS  command  model  which  has  an  impractical  amount  of  lead 
compensation  because  of  noise  resulting  from  high-order  derivative  terms.  For  this 
reason,  these  components  have  been  excluded  from  the  aircraft  model,  and  accounted  for 
by  placing  their  approximate  transfer  function  in  the  AFCS  command  path.  A  simplified 
block  diagram  of  the  control  law  implemented  in  the  yaw  axis  is  provided  in  Fig.  7.  The 
AFCS  state  commands  are  effectively  delayed  to  provide  good  matching  between  commanded 
and  sensed  aircraft  states. 


AFCS  Modes  of  Operation 

The  Mode  Select  status  Panel  (MSSP)  (Fig.  8)  provides  the  pilot  with  the  capability  of 
selecting  various  AFCS  modes  in  flight.  Selectable  modes  of  operation  include:  Heading 
Hold  (HDG),  Barometric  Altitude  Hold  (bAko),  Radar  Altitude  Hold  (RAD),  Velocity 
Stabilization  (VELSTAB),  and  Hover  Assist  (HVR) .  The  "basic”  mode  of  operation  of  the 
AFCS  (referred  to  as  the  "core  AFCS”)  results  when  all  selectable  modes  are  disengaged. 
Core  AFCS  functions  are  outlined  in  Table  2.  For  low  speed  operations,  the  core  AFCS 
provides  an  attitude  command/attitude  stabilization  (AT/AT)  system  in  pitch  and  roll,  an 
acceleration  command/rate  stabilization  (AC/RA)  system  in  yaw,  and  an  acceleration 
command  system  in  the  vertical  axis  whic'  ''""tains  no  stabilization  signals.  In  forward 
flight,  the  core  AFCS  provides  a  pitch  atc.^  ...de/airspeed  hold  (AT/AS)  system,  a  roll 
rate/roll  attitude  (RA/AT)  system,  an  AC/RA  system  in  yaw,  and  an  acceleration  command 
system  in  vertical.  Turn  coordination  is  also  provided  in  the  "core”  AFCS. 


Selectable  AFCS  mode  functions  are  defined  in  Table  3.  Pilot  comments  indicate  that  the 
Heading  Hold  feature  should  be  included  as  part  of  the  core  system  since  this  feature 
tended  to  reduce  pilot  workload  significantly  for  most  tasks. 


PROGRAM  SCHEDULE 


CONDUCT  OF  TEST 


Test  activities  accomplished  on  the  ADOCS  Demonstrator  aircraft  from  April  1985  to  date 
are  shown  in  Fig.  9.  Integration  of  the  DOCS  on  the  UH-60A  aircraft  was  validated 
before  actual  flight  testing  using  the  Boeing  Vertol  simulation  facility.  The  aircraft 
was  placed  adjacent  to  the  simulation  lab.  Flight  characteristics  of  the  basic  UH-60A 
were  represented  with  a  six  degree  of  freedom,  non-linear  total  force/moment  math  model 
programmed  on  a  Perkin  Elmer  Multi-processor  computer  used  for  real-time  piloted 
simulation.  The  entire  PFCS  comprising  side-stick  controllers,  optical  transducers  and 
signal  paths,  digital  FCPs,  DOCS  actuators  and  other  subsystems  were  operated  closed 
loop  on  the  aircraft  for  pilot  in-the-loop  validation  testing.  The  simulator 
camera/terrain  board  system  provided  visual  cues  to  the  pilot  via  four  television 
monitors  mounted  directly  in  front  of  the  UH-60  cockpit  windows.  Thorough  testing  of 
all  PFCS  hardware/software  interfaces  and  control  logic  was  accomplished  during  this 
simulation  task. 


Following  hardware-in-the-loop  simulation,  the  aircraft  was  transferred  to  the 
Wilmington  Flight  Test  Center  where  a  five  week  period  of  ground  testing  was  conducted 
prior  to  first  flight.  Because  of  the  major  modifications  made  to  the  UH-60A,  both  the 
DOCS  and  production  systems  were  ground  tested  before  flight  releases  were  granted. 
Flight  testing  of  the  ADOCS  aircraft  began  on  October  23,  1985.  First  flights  were 
conducted  to  insure  production  UH-60  system  integrity  and  to  confirm  that  the  newly 
installed  DOCS  did  not  interfere  with  normal  Back-up  Control  System  (BUCS)  operation. 
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During  these  initial  tests,  the  DOCS  was  powered,  but  was  mechanically  disconnected  from 
the  UH-60  upper-boost  actuators,  i.e.  the  DOCS  could  be  flown  open-loop.  These  flights 
were  used  to  evaluate  sensor  performance  and  interfaces  by  monitoring  internal  flight 
control  processor  ( FCP )  parameters. 

The  first  closed-loop  DOCS  flight  took  place  on  November  7,1985.  This  flight  was  the 
first  of  many  which  were  used  to  evaluate  and  develop  the  PFCS.  Evaluation  of  the  PFCS 
included  testing  of  the  DOCS  Monitor  (safety  system)  performance,  aircraft  response  and 
pilot  recovering  from  simulated  AFCS  failures,  and  evaluation  of  unaugmented  handling 
qualities . 

As  the  PFCS  evaluation  phase  was  nearing  completion  and  unaugmented  design  objectives 
were  being  met,  AFCS  testing  began.  Initial  AFCS  evaluations  included  reviewing  the 
system’s  digital  effects  on  aircraft  stability  while  optimizing  feedback  paths  to 
provide  desired  levels  of  gust  rejection  and  dancing.  With  the  stability  loops  defined, 
command  model  response  characteristics  were  optimized  to  provide  the  pilot  with 
desirable  responses  throughout  the  flight  envelope.  Selectable  modes  were  also 
optimized  and  evaluated  in  this  phase.  Finally,  NOE  evaluations  were  conducted  as  well 
as  air-to-air  tracking  and  air-to-ground  target  acquisition  tasks. 

DATA  COLLECTION 

In  addition  to  numerous  data  parameters  monitored  in  real-time  and  recorded  in-flight, 
pilot  Cooper-Harper  ratings  and  supporting  pilot  comments  were  obtained  to  evaluate  the 
DOCS  handling  qualities.  Averaged  data  presented  herein  consist  of  combined  ratings 
from  all  evaluation  test  pilots  when  possible. 

TASK  DESCRIPTION 

The  evaluation  tasks  selected  specifically  to  evaluate  PFCS  handling  qualities  are 
described  below.  Typically,  Category  B  and  C  tasks7  were  performed  for  PFCS  evaluation 
as  they  were  felt  most  typical  of  degraded  mode  operation.  Tasks  used  to  evaluate  the 
handling  qualities  with  the  AFCS  operating  were  baBed  on  the  proposed  handling  qualities 
specification  -  ADS-33®  which  includes  more  aggressive  and  precise  maneuvers  typical  of 
NOE  flight.  PFCS  evaluation  tasks  demonstrated  "get  home"  capability  in  the  event  of 
multiple  AFCS  system  failures.  Tasks  included:  mild  turns,  climbs,  descents,  traffic 
pattern  maneuvers,  low-speed  flight,  and  landings.  AFCS  tasks  were  designed  to  examine 
all  facets  of  NOE  flight  and  put  more  emphasis  on  precise  maneuvering.  Low-speed  tasks 
performed  in  the  evaluation  of  the  AFCS  included:  lateral  jink,  accel/decel,  slalom, 
hover  turn,  bob-up/down,  precision  hover,  and  takeoff /landing.  Tasks  performed  at 
higher  speeds  included:  roller  coaster,  high  angle  turns,  approach  to  hover,  and 
simulated  auto rota tion .  A  detailed  description  of  the  evaluation  tasks  performed  during 
these  evaluations  are  included  in  Refs.  4  and  9. 

PILOTED  EVALUATION  OF  THE  PFCS 

Modification  of  PFCS  system  parameters  and  algorithms  was  performed  during  piloted 
testing  to  obtain  Level  2  handling  qualities  and  meet  design  objectives.  Final  results 
of  the  PFCS  handling  qualities  evaluation  are  summarized  in  this  section  with  a 
discussion  of  the  results  organized  as  follows: 

Requirements  for  automatic  trim  follow-up  and  control  shaping 
Notch  filtering  for  elimination  of  pilot/airframe  coupling 
-  Side-stick  controller  configuration  effects 
Comparison  of  DOCS  and  BUCS 

AUTOMATIC  TRIM  FOLLOW-UP  RATES 

Control  trim  follow-up  rates  were  increased  in  all  axes  during  flight  test  optimization 
of  the  PFCS.  Both  the  maximum  integration  rate  size  and  the  trim  lag  time  constant  were 
altered  to  increase  the  effective  trim  follow-up  rate.  The  need  for  reducing  trim 
forces  at  a  faster  rate  was  attributed  to  the  increased  stability  of  the  actual  aircraft 
compared  to  the  simulator.  The  stability  level  of  the  unaugmented  UH-60A  math  model  in 
the  simulator  was  perceived  to  be  lower  than  the  actual  aircraft.  This  occurred  because 
of  the  limited  visual  field-of-view  and  weak  motion  cues  particularly  when  performing 
large  excursion  maneuvers  from  one  trim  flight  condition  to  another.  Thus,  normal  pilot 
control  techniques  tended  to  be  less  aggressive  in  the  simulator  resulting  in  slower 
automatic  trim  follow-up  rates. 

DYNAMIC  SHAPING 

Dynamic  shaping,  consisting  of  a  lead-lag  shaping  network,  was  provided  to  increase 
pilot  perceived  bandwidth  in  both  the  longitudinal  and  directional  axes.  Significant 
changes  to  this  shaping  occurred  during  flight  testing  because  of  the  simulator 
limitations  previously  stated.  Fig.  10  presents  the  frequency  response  of  three 
longitudinal  axis  lead-lag  filters  evaluated  in  flight  test.  As  shown,  simulation 
studies  resulted  in  a  filter  design  which  provided  the  least  amount  of  phase  advance. 
This  shaping  when  evaluated  in  flight  test  resulted  in  pilot  complaints  of  response 
sluggishness.  When  the  lead-lag  was  modified  to  provide  a  maximum  of  35  degrees  advance 
instead  of  10  degrees,  the  pitch  axis  was  judged  too  snappy  and  responsive  causing  a 
tendency  to  over-control  in  pitch.  The  final  configuration  selected  provides  15  degrees 
phase  advance  and  is  actually  the  closest  to  the  analytically  predicted  requirements 
previously  described  under  system  description.  The  final  configuration  succeeded  in 


minimizing  the  high  frequency  control  inputs  in  the  pitch  axis  and  provided  enough 
quickening  to  effectively  reduce  pilot  workload.  Similar  results  were  obtained  in  the 
directional  axis.  Flight  test  results  confirmed  that  no  shaping  in  either  the  lateral 
or  vertical  axes  was  required  to  achieve  Level  2  handling  qualities  with  the  PFCS. 

PILOT/AIRFRAME  COUPLING 

Under  certain  flight  maneuvers  when  constant  SSC  force  inputs  were  required  and  aircraft 
structural  vibration  levels  were  high,  a  bio-mechanical  feedback  through  the  pilot's  arm 
and  into  the  control  paths  resulted.  This  condition  most  frequently  occurred  during 
forward  flight  climbs  or  d  scents.  The  pilot,  while  holding  a  steady  collective 
command,  experienced  a  high  level  of  cockpit  vibration  at  6.5  hz  (Fig.  11)  which  fed 
directly  through  the  pilots  arm  into  the  SSC.  Removal  of  the  control  force  eliminated 
the  vibration  by  effectively  opening  the  structural  feedback  loop.  A  digital  notch 
filter  was  designed  and  implemented  in  the  collective  control  command  path  to 
essentially  attenuate  all  6.5  hz  control  inputs.  Similar  notch  filters  were  included  in 
all  axes  to  eliminate  any  Pilot  Induced  Oscillation  (PIO)  tendencies.  Since  the 
addition  of  these  notch  filters,  no  PIO  tendencies  have  been  noted. 

SIDE- STICK  CONTROLLER  CONFIGURATION  EFFECTS 

Initial  flight  test  evaluation  of  the  PFCS  was  performed  using  the  integrated  four-axis 
controller  configuration,  i.e.  (4+0).  With  this  configuration,  pilots  found  it 
difficult  to  isolate  problem  areas  because  of  inherent  controller  induced  coupling 
effects.  The  use  of  separated  controls  (i.e.  the  (2+1+1)  and  (3+1 ) Collective 
configurations)  allowed  pilots  to  concentrate  on  responses  axis  by  axis.  In  this 
manner,  single-axis  responses  as  well  as  automatic-trim  rate  could  be  optimized  before 
multi-axis  maneuvers  were  evaluated.  Following  the  evaluation  of  the  PFCS  with  the 
(2+1+1)  controller  configuration,  testing  of  the  PFCS  with  the  (3+1 )Collective 
configuration  was  conducted.  The  majority  of  flight  testing  was  devoted  to  this 
configuration.  Finally,  after  successful  integration  of  the  three  control  (pitch,  roll, 
and  yaw)  on  the  SSC  was  completed,  attention  was  again  focused  on  evaluation  of  the 
four-axis  configuration. 

Average  pilot  ratings  for  the  three  side-stick  controller  configurations  evaluated 
during  PFCS  optimization  are  presented  on  Fig.  12.  in  general,  separated  controller 
configurations  yielded  improved  pilot  ratings  compared  to  the  four-axis  configuration. 
The  largest  benefit  indicated,  and  supported  by  pilot  comments,  resulted  from  the 
separation  of  the  power  (collective)  control.  Removal  of  collective  control  from  the 
right-hand  SSC  allowed  pilots  to  set  power  at  a  desired  setting  and  concentrate  on 
controlling  the  other  axes . 

When  the  collective  control  was  implemented  on  the  right-hand  SSC  (i.e.  (4+0) 
configuration),  control  inputs  in  pitch,  roll  or  yaw  tended  to  couple  into  the  vertical 
axis  resulting  in  a  significant  increase  in  pilot  workload.  This  added  workload  was 
most  noticeable  for  precision  tasks  performed  near  the  ground.  Pilot  performance  during 
liftoff  and  landing  was  degraded  significantly  when  performed  with  the  (4+0) 
configuration.  Fig.  12  shows  that  ratings  for  these  two  tasks  were  degraded  by  two 
pilot  rating  points  compared  to  either  the  (3+1)  or  (2+1+1)  configurations.  For  less 
demanding  tasks,  pilot  ratings  with  the  (4+0)  configuration  were  typically  degraded  by 
approximately  one  HQR  point  compared  to  the  (3+1 )Collective  configuration. 

Best  pilot  ratings  were  achieved  with  the  (2+1+1)  controller  configuration.  Evaluations 
of  the  (2+1+1)  configuration  (performed  briefly  during  initial  PFCS  testing)  indicate 
the  added  benefit  of  fully  separated  collective  and  directional  controls  for  most  tasks. 
Level  1  ratings  were  obtained  for  multi-axis  turning  tasks  with  the  (2+1+1) 
configuration  without  stability  augmentation.  In  addition,  Level  1  pilot  ratings  were 
also  obtained  for  the  hover  and  taxi  tasks. 

DOCS-BUCS  COMPARISON 

Handling  quality  comparisons  were  performed  between  the  DOCS  PFCS  and  the  UH-60 
mechanical  controls  (BUCS)  to  assess  how  well  design  objectives  of  the  PFCS  were  being 
met.  Evaluations  by  the  BUCS  pilot  were  performed  with  both  the  production  SAS  and 
force-feel  systems  selected  off. 

A  comparison  between  the  average  pilot  rating  data  for  the  (3+1 JCollective  configuration 
and  the  unaugmented  BUCS  system  is  presented  in  Fig.  13.  As  shown,  comparable  pilot 
ratings  were  obtained  for  both  configurations.  Pilot  comments  indicate  that  some  tasks, 
specifically  the  up-and-away  turns  and  approach  to  hover  tasks  were  performed  better 
with  the  DOCS.  High  workload  tasks,  such  as  landings  and  takeoffs  were  performed  more 
deliberately  with  the  DOCS.  Much  of  this  cautiousness  was  attributed  to  pilot  learning 
and/or  experience.  It  should  be  noted  that  numerous  evaluation  pilots  successfully 
performed  hovering  and  landing  tasks  in  an  unaugmented  state  during  the  second  hour  of 
their  DOCS  flight  evaluation. 

PILQTE  REVALUATION  OF  THE  AFCS 

STABILITY  AND  COMMAND  CHARACTERISTICS 

By  applying  both  analytical  techniques  and  in-flight  test  optimization,  the  ADOCS 
control  laws  achieved  an  excellent  level  of  stability  in  all  axes.  Table  4  presents  a 
summary  of  system  bandwidth  and  stability  margins  as  predicted  by  a  system  model  which 
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includes  a  6-DOF  aircraft  model.  Data  presented  in  Table  4  are  for  the  hover  flight 
condition.  The  system  parameters  presented  in  this  table  reflect  the  closed  loop 
response  of  the  aircraft  to  external  inputs  as  opposed  to  pilot  commands  which  pass 
through  the  ADOCS  command  model . 

The  command  characteristics  of  each  axis  are  presented  in  Table  5.  System 
characteristics  have  been  selected  to  be  acceptable  for  all  tasks.  Both  the  stability 
and  command  response  characteristics  will  be  verified  by  in-flight  frequency  response 
testing10  scheduled  to  be  conducted  later  this  year. 

Attitude  Command  Systems 

Many  hours  of  piloted  simulation  were  utilized  during  the  ACC/AFCS  program3  to  optimize 
the  pitch  and  roll  attitude  command  systems  for  low-speed  NOE  tasks.  During  flight  test 
optimization,  a  modification  to  the  desired  response  characteristics  of  the  pitch/roll 
command  model  was  required.  Initially,  both  the  pitch  and  roll  command  models  included 
very  low  trim  follow-up  gains.  These  gains  were  increased  significantly  during  flight 
testing  changing  only  the  low-frequency  portion  of  the  desired  response  definition.  It 
was  critical  to  quickly  minimize  steady-state  forces  being  held  by  the  pilot.  The 
frequency  response  of  the  pitch  axis  AT/AT  command  model  is  indicated  in  Fig.  14  for 
both  the  initial  and  current  definitions.  The  overall  sensitivity  and  response  shape 
(frequency  and  damping)  of  the  short  period  response  did  not  change  significantly  from 
the  results  of  previous  ACC/AFCS  simulation  efforts. 

VERTICAL  AXIS  RESPONSE  CHARACTERISTICS 

"Core11  AFCS 

The  "core"  vertical  control  laws  provided  a  normal  acceleration  proportional  to  pilot's 
force  input.  The  response  is  very  similar  to  the  response  with  only  the  PFCS  operating. 
The  acceleration-type  response  enabled  the  pilot  to  set  engine  power  at  a  desired  value 
while  eliminating  any  requirement  to  hold  constant  forces.  However,  precise  control  of 
aircraft  rates  of  clirab/descent  required  much  learning  and  concentration.  Pilot 
comments  indicate  that  there  was  an  exceptionally  high  amount  of  compensation  required 
to  control  the  vertical  axis.  As  such,  the  performance  of  almost  all  low-altitude  tasks 
was  degraded  because  of  the  high  pilot  workload  in  the  vertical  axis.  It  should  be 
noted  that  overall  control  of  the  vertical  axis  with  the  "core"  system  was  accomplished 
with  an  unacceptably  high  amount  of  attention  paid  to  the  engine  torque  indicators  in 
the  cockpit.  Pilot  comments  indicate  that  this  is  primarily  due  to  the  lack  of  tactile 
feedback  provided  by  a  collective  force  controller  combined  with  the  long  lag  associated 
with  the  aircraft's  vertical  response  characteristics. 


Altitude  Hold 

Both  radar  and  barometric  altitude  hold  systems  are  included  in  the  ADOCS  demonstrator 
aircraft.  RADALT  can  be  selected  if  altitude  is  less  than  1000  ft  AGL.  With  either 
system  selected,  vertical  control  laws  are  configured  to  provide  a  rate-of-climb  command 
system.  The  vertical  rate  command  response  in  conjunction  with  the  long-term  altitude 
hold  feature  dramatically  reduced  pilot  workload  for  many  evaluation  tasks.  However, 
because  of  complementary  filtering  performed  on  the  radar  altitude  signal,  RADALT  did 
not  provide  as  tight  an  altitude  hold  as  desired  during  aggressive  maneuvering  in  other 
axes.  For  example,  during  a  20  deg  nose  up  deceleration  through  the  translational  lift 
region,  altitude  deviations  of  up  to  15  ft  were  recorded.  This  system  characteristic 
requires  further  analysis  and  modifications  to  meet  SCAT  mission  requirements. 

YAW  AXIS  RESPONSE  CHARACTERISTICS 

During  testing  to  optimize  yaw  rate  response  in  hover  with  heading  hold  engaged,  a 
compromise  was  necessary  between  the  time  constant  of  the  desired  rate  response  and  the 
deceleration  response  of  the  aircraft  to  lock  onto  a  heading.  That  is,  pilots  desired  a 
rapid  rise  time  to  start  a  yaw  maneuver,  but  preferred  a  slower  rise  time  to  stop  at  a 
new  heading  reference.  Typical  pilot  technique  for  yaw  control  with  the  SSC  involved 
the  smooth  application  of  control  forces  followed  by  a  rapid  release.  In  order  to 
handle  this  non-linear  control  requirement,  the  yaw  axis  derivative  rate  limit  (DRL) 
parameters  were  adjusted  to  soften  accelerations  jerks  for  rapid  release  of  control 
forces.  The  DRL  did  not  affect  yaw  response  for  normal  modulation  of  control  input 
forces  which  resulted  in  crisp  and  precise  heading  changes. 

PILOT  RATINGS 

Handling  quality  comparisons  were  performed  between  the  DOCS  AFCS  and  the  UH-60 
mechanical  controls  (referred  to  as  BUCS)  to  assess  how  well  design  objectives  were  met. 
Evaluations  on  BUCS  were  performed  with  both  the  production  SAS  and  force  feel  systems 
selected  on.  Pilot  rating  data  presented  consist  of  averaged  ratings  for  each  pilot. 

All  data  presented  were  obtained  with  the  (3+1  Collective  SSC  configuration. 

An  assessment  of  task  performance  with  both  the  ADOCS  and  UH-60  control  system  was 
performed  by  the  Boeing  evaluation  pilot.  A  comparison  of  pilot  ratings  for  each 
control  system  configuration  is  given  in  Fig.  15  for  low-speed  tasks  and  in  Fig.  16  for 
forward  flight  tasks.  AFCS  mode  status  for  ADOCS  evaluations  are  noted  on  each  figure. 

A  discussion  of  pilot  rating  data  including  pilot  comments  is  given  below. 
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Low-Speed  Evaluation  Tasks 

Pilot  ratings  with  ADOCS  were  on  the  average  slightly  improved  over  ratings  obtained 
with  the  BUCS  for  most  of  the  low-speed  tasks  performed  (Fig.  15).  Level  1  ratings  were 
not  obtained  for  either  control  system  for  the  hover  about  a  point  and  dash/quickstop 
tasks.  The  hover  about  a  point  task  required  continuous  pilot  control  activity  in  all 
axes  and  average  pilot  ratings  of  4.0  were  given  for  this  high  workload  task.  Ratings 
for  the  dash/quickstop  varied  from  CHR  3  to  CHR  5  depending  on  how  aggressively  the  task 
was  performed.  Large  commanded  pitch  rates  and  attitudes  caused  control  deficiencies  in 
the  vertical  axis  to  become  more  evident.  Higher  longitudinal  SSC  forces  required  to 
perform  an  aggressive  accel/quickstop  maneuver  also  produced  a  porpoise  or  PIO  tendency 
in  pitch. 

For  certain  precision  low-speed  maneuvers  including  the  hover  turn,  slalom,  rearward 
flight,  bob-up,  and  lateral  jink,  pilot  performance  was  noticeably  better  with  the  ADOCS 
than  the  standard  UH-60  system.  Pilot  comments  indicate  that  the  small-displacement  SSC 
improved  their  performance  of  these  tasks,  especially  if  vertical  axis  control  workload 
was  minimal . 

Forward  Flight  Evaluation  Tasks 

For  all  tasks  except  autorotation,  Level  1  HQRS  were  obtained  with  the  ADOCS  (Fig.  16). 
The  DOCS  lateral  axis  controllability  was  judged  superior  to  existing  rotorcraft.  The 
box  pattern,  a  precise  lateral/direction  task,  was  performed  easily.  Sixty  degree  bank 
turns  were  made  with  no  apparent  overshoot  using  roll  rates  in  excess  of  40  deg/sec. 

The  pilot  commented  on  "feeling  in  control"  and  "very  comfortable"  while  doing  these 
tasks.  Evaluation  of  the  BUCS  resulted  in  Level  1  ratings  for  all  tasks  except  the  60 
deg  bank  turn  maneuver.  For  this  task,  lateral  controllability  was  judged  deficient 
when  compared  to  the  ADOCS.  Autorotation,  as  expected  from  the  PFCS  evaluation,  was 
more  easily  performed  with  the  BUCS  large  displacement  collective  controller.  Based  on 
this  task,  as  well  as  low-speed  altitude/thrust  control  tasks,  a  medium  displacement 
collective  controller  to  provide  improved  tactile  feedback  to  the  pilot  in  the  vertical 
axis  is  recommended. 


SUMMARY 

A  fly-by-light  Black  Hawk  has  demonstrated  state-of-the-art  flight  control  technologies 
since  November  1985.  Development  of  a  PFCS  and  integrated  multi-axis  side-stick 
controllers  was  successfully  accomplished  achieving  Level  2  handling  qualities.  An 
AFCS  was  designed  which,  for  most  SCAT  mission  tasks,  yielded  reduced  pilot  workload  and 
Level  1  handling  qualities.  Major  findings  resulting  from  flight  test  evaluation  of  the 
DOCS  are  summarized  as  follows: 

1.  An  attitude  command  system  in  the  pitch  and  roll  axes  resulted  in  level  1  handling 
qualities  for  low-speed  NOE  flight. 

2.  Higher  trim  follow-up  gains  in  both  the  pitch  and  roll  attitude  command  systems 
were  required  to  more  quickly  trim  out  steady  state  forces  and  achieve  level  1  handling 
qualities . 

3.  Non-linear  shaping  to  obtain  desired  control  sensitivities  for  small  precise 
maneuvering  and  to  minimize  control  forces  during  large  maneuvers  is  necessary  for  pilot 
acceptance  of  force-type  controllers.  However,  it  was  found  that  for  some  conditions, 
large  sensitivity  changes  produced  by  the  non-linear  shaping  causes  pilot  induced 
oscillations. 

4.  Heading  Hold  was  found  to  dramatically  reduce  pilot  workload  during  near-ground 
operation. 

5.  Hover  Assist,  though  it  tended  to  drift  as  a  function  of  the  Doppler 
ground-speed  sensor,  was  found  to  decrease  pilot  workload  for  the  precision  hover  task. 

6.  Phase  delays  introduced  by  all  system  components,  including  digital  effects  due  to 
asynchronous  operation  of  processors,  must  be  accounted  for  in  predicting  system  gain 
requirements  and  system  performance. 

7.  A  unique-trim  force  vertical  controller  degraded  pilot  performance  in  high 
workload  situations  where  the  pilot  requires  a  continual  cross  check  of  torque  in  the 
cockpit  (i.e.  power  setting  and  control  position).  Based  on  these  results,  a  medium- 
displacement  collective  controller  should  be  evaluated  and  compared  to  unique  trim 
force  controllers  with  improved  control  laws  and/or  displays. 
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Figure  1.  ADOCS  Demonstrator  Aircraft. 


Figure  2.  SSC  Locations  in  ADOCS 
Demonstrator. 
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Figure  3-  ADOCS  Controller  Configurations. 


AXIS 

DISPLACEMENT 

MAX.  FORCE 

STIFFNESS 

LONGITUDINAL 

*  8.8  DEG 

18.4  LB 

2.09  LB/DEG 

LATERAL 

±  8.8  DEG 

14.7  LB 

1.67  LB/DEG 

DIRECTIONAL 

i.  7.5  DEG 

37.5  IN-LB 

5  IN-LB/*>EG 

VERTICAL 

i.  0.166  IN 

15.77  LB  (UP) 

14.11  LB  (ON) 

_ 

95  LB/IN  (UP) 

85  LB/IN  (DN) 

Table  I.  ADOCS  4- Axis  SSC  Force! Displacement  Characteristics 


Figure  4.  Elements  of  ADOCS  Primary  Flight  Control  System. 
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Figure  6.  ADOCS  Model  Following  Concept. 
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Table  3.  ADOCS  Selectable  Mode  Functions. 


Figure  9.  ADOCS  Demonstrator  Test  Activities. 
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Figure  10  Dynamic  Shaping  in  Longitudinal  Ajci.v 
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Figure  II.  Collective  Input  Time  History. 


PFCS  Evaluation  Task 


Figure  12.  Effect  of  SSC  Configuration  on  Pilot  Handling  Quality  Rating. 


PFCS  Evaluation  Task 

Figure  12  Comparison  of  BL’CSIDOCS  Handling  Quality  Ratings 


Table  4.  ADOCS  Stability  Characteristics. 


AXIS 

RESPONSE 

TYPE 

FREQUENCY 

(RAD/SEC) 

DAMPING 

RATIO 

PITCH 

ATTITUDE 

2.0 

1.0 

ROLL 

ATTITUDE 

2.5 

1.0 

nvLu 

RATE 

5.7 

1.0 

YAW 

RATE 

2.0 

1.0 

VERT 

RATE 

2.0 

1.0 

Table  5.  ADOCS  Command  Model  Characteristics. 
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Figure  14.  Longitudinal  Axis  ATI  AT  Command!  Response  Characteristics. 


Figure  16.  Demonstrator  Forward  Flight  Handling  Qualities  Evaluation. 
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SUMMARY 

Despite  spectacular  advances  in  display  systems  and  data  handling  technologies,  modern  crew  systems 
confront  their  operators  with  a  staggering  volume  of  codified  information  which  competes  for  scarce 
attentional  and  control  resources.  Unabated,  these  increasing  psychological  and  physiological  demands 
have  potential  to  undermine  critical  technology  gains  in  system  performance.  While  it  is  generally 
accepted  that  the  human  operator's  ability  to  acquire,  process  and  make  effective  control  decisions  using 
task  critical  information  is  a  key  contributor  to  system  effectiveness,  there  are  significant 
difficulties  in  translating  this  to  meaningful  action  in  the  processes  of  crew  system  design  and 
acquisition.  Recognition  of  this  problem  has  spurred  concerted  efforts  across  DoD  to  attempt  to 
influence  early  design  tradeoffs  in  favor  of  an  improved  match  between  crew  system  specifications  and 
operator  capability. 

Achieving  an  optimal  fit  between  system  capabilities  and  the  perceptual  and  performance 
characteristics  of  the  operator  requires  the  presence  of  at  least  three  elanents:  (1)  Usable  Data 
Resources.  Human  performance  data  are  needed  in  a  form  and  level  of  precision  that  can  be  traded  off 
against  other  design  variables;  (2)  An  Effective  Interface  providing  methods  and  media  to  support 
accession  and  evaluation  of  these  data  with  respect  to  equipment  requirements.  To  be  effective,  this 
interface  must  act  to  lower  the  cost  (time,  resources,  risk,  etc)  of  acquiring  pertinent  data 
proportional  to  its  perceived  value.  (3)  Sophisticated  and  Motivated  Users.  Designers,  design  management 
and  system  acquisition  personnel  need  to  understand  and  place  value  on  the  use  of  ergonomics  in  the 
design  of  effective  systems.  Designing  for  active  presence  of  these  elements  requires 
understanding  of  and  assumes  some  ability  to  influence  individual,  organizational  and  regulatory 
variables  that  jointly  support  the  design  and  acquisition  processes. 

I .  INTRODUCTION 

The  evolution  of  the  flight  crew  system  from  the  early  days  of  aviation  to  the  present  has  involved  a 
stunning  growth  of  complexity  in  terms  of  the  demands  on  the  pilot  and  the  sheer  number  of  controls  and 
displays  needed  to  support  wide  ranging  mission  requirements  (Fig  1).  While  dramatically  extending  the 
capabilities  of  modern  military  systems,  the  technological  advances  in  avionics  and  information  handling 
technologies  over  the  past  few  years  have  also  pressed  at  the  limits  of  operator  performance 
capabilities. 

Current  attempts  to  overcome  this  problem  have  followed  two  fundamentally  different  approaches. 

First  have  been  approaches  typified  by  the  use  of  multifunction  and/or  computer  driven  menu  display 
technology  in  recent  crew  systems  (Fig  2)  which  are  aimed  at  reducing  the  apparent  volume  of  information 
simultaneously  competing  for  the  operator's  attention.  Aside  from  any  hunan  factors  advantages,  these 
approaches  provide  the  major  engineering  benefit  of  freeing  up  scarce  crew  system  real  estate  thereby 
permitting  the  integration  of  additional  avionics  technologies  that  are  clanmoring  for  tickets  to  fly. 

The  major  disadvantage  of  this  approach  is  that  critical  information  may  not  be  immediately  available  at 
the  moment  of  need  in  the  rapidly  shifting  dynamics  of  modern  air  combat.  Concern  over  this  potential 
problem  has  spurred  the  research  and  development  of  new  technologies  aimed  at  rapidly  reconfiguring  the 
crew  system  information  suite  in  a  manner  adaptive  to  changing  circumstances.  For  example,  proposed 
applications  of  machine  intelligence  in  the  crew  system  —  as  in  DARPA's  Pilot  Associate  —  are  expected 
to  be  able  to  aid  the  operator  in  both  the  rapid  interpretation  of  information  and  in  the  performance  of 
mission  tasks  —  thereby  altering  the  allocation  of  man-machine  functions  in  future  flight  crew  systems. 

The  second  major  approach  is  concerned  with  reducing  operator  load  by  matching  the  bandwidth  of  crew 
system  controls  and  displays  to  the  physiolog ica  1 ,  psychological  and  psychomotor  capabilities  and 
limitations  of  the  operator.  This  approach  stems  from  ergonomic  concerns  over  the  human  operator's 
ability  to  integrate  information  from  a  disparate  array  of  highly  codified  bits  of  information  into  a 
unified  awareness  of  the  situation  vital  to  effective  mission  performance.  A  major  weakness  of  this 
approach  is  that  it  depends  on  driving  the  state-of-the-art  of  control  /display  information  portrayal 
technologies  based  upon  illdefined,  little  understood  and  at  best  controversial  models  and  notions  of 
operator  performance.  Because  of  the  risks  and  uncertainties  associated  with  this  approach  —  i.e.  it 
has  tended  to  be  research  rather  than  development  —  it  has,  in  the  past,  lacked  the  threshold  level  of 
support  needed  to  attain  critical  mass.  More  recently,  research  sponsored  by  Reising  (1,2)  coupled  with 
spectacular  accomplishments  on  virtual  display  interfaces  by  Furness,  Kocian  and  colleagues  (3)  have 
provided  the  fundamental  technology  breakthroughs  needed  to  rekindle  "development"  interest  in  this 
"human-centered"  approach. 

The  crucial  link  to  the  success  of  either  of  these  approaches,  or  a  hybrid  of  the  two  (i.e.  a  "super 
cockpit";  fig  3;  ref  4)  is  the  ability  to  translate  our  fundamental  understanding  of  the  human  operator 
into  relevant  and  applicable  actions.  While  a  staggering  volume  of  research  findings  exists,  it  remains 
difficult  to  pinpoint  a  direct  linkage  between  the  implications  of  this  research  and  the  basic  insights 
needed  to  design  these  human-centered  systems.  While  human  factors  researchers  typically  rationalize  or 
justify  the  relevance  of  their  projects  on  the  basis  of  real  problems,  they  generally  believe  their 
responsibil ity  to  actually  solving  these  problems  ends  with  publication  of  their  findings.  Overall,  there 
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appears  to  be  a  lack  of  sensitivity  on  the  part  of  the  behavioral  research  community  to  the  designer  as 
an  end  user  of  this  information.  In  particular,  there  is  little  or  no  understanding  of  the  factors  that 
influence  the  ability  of  designers  to  acquire,  process  and  make  effective  decisions  using  ergonomics.  As 
a  result,  ergonomics  information  and  the  knowledge,  tools  and  metrics  to  use  this  effectively  in  system 
design  are  urgently  in  demand.  The  principal  objective  of  this  report  is  to  identify  and  discuss  these 
factors  in  the  context  of  the  pragmatic  options  available  for  the  human  factoring  of  crew  system  design. 

II.  HUMAN  FACTORING  ERGONOMICS  DATA  TO  SUPPORT  CREW  SYSTEM  DESIGN 

Systematic  consideration  of  ergonomics  data  in  crew  system  design  decisions  and  tradeoffs  appears  to 
be  hampered  by  a  variety  of  interdependent  factors  stemming  from  the  nature  of  design  problems  and 
process,  organizational  and  regulatory  environments,  the  nature  of  designers,  and  the  availability  and 
utility  of  relevant  technical  knowledge  resources  (5). 

Much  has  already  been  documented  in  the  literature  on  the  general  logic  and  formalisms  associated 
with  the  process  of  design  (6,7).  Likewise,  many  accounts  exist. of  the  apparent  and  hidden  complexities 
associated  with  the  design  of  military  systems  (8).  In  formal  descriptions,  system  design  is  frequently 
characterized  as  an  orderly,  hierarchical  process.  However,  in  reality,  it  tends  to  be  somewhat  chaotic 
involving  many  iterative  steps,  stages  and  procedures  dependent  on  the  control  and  communications  of 
multiple  individuals  and  organizations  with  their  respective  skills,  biases  and  inclinations  (9,10). 

Fundamentally,  the  goal  of  system  design  is  to  onceive  an  artifact  whose  form  and  function  match  a 
set  of  defined  needs  and  requirements  within  defined  coc.t,  schedule  and  material  constraints.  It  is  a 
cumulative  function  of  a  multitude  of  design  decisions  and  tradeoffs  which  are,  in  turn,  dependent  on  the 
information  and  experience  factored  into  them.  Hence,  design  decisions  made  without  consideration  of 
potentially  leveraging  information  may  be  suboptimal  and  may  collectively,  depending  upon  their  impact  on 
system  function,  undermine  design  effectiveness  (9,11). 

The  design  decision  process  (simply  schematized  in  fig  4)  is  best  represented  as  a  subjective 
integration  of  information  resources  and  personal  experience  which  is,  in  turn,  constrained  by 
limitations  of  available  time  and  resources.  The  nature  of  this  integration  is  not  well  understood 
though  it  probably  involves  a  variety  of  cognitive  processes  including  analytic  and  analogic  reasoning, 
pattern  recognition,  informal  hypothesizing,  and  mental  modeling  which  are  often  collectively  referred  to 
as  creative  intuition.  At  different  times,  single  individuals  or  individuals  working  together  as  a  team 
may  be  involved.  It  is  an  iterative  process,  recurring  at  all  stages  and  levels  (i.e.  system  through 
component  levels)  of  a  given  design. 

The  interdependence  among  the  myriad  factors  which  contribute  to  the  design  of  complex  systems  makes 
it  difficult  to  predict  the  influence  of  any  single  factor,  bit  of  information  or  decision  on  a  given 
design.  In  contrast  to  this  apparent  unpredictability,  the  pressures  of  limited  time  and  resources 
typical  in  system  design  drive  designers  to  bias  decisions  and  tradeoffs  toward  reduction  of  uncertainty 
and  risk.  Hence,  the  selection  of  appropriate  baselines  —  a  proven  system  or  subsystem  analogous  to 
the  one  under  development  —  will  generally  account  for  the  largest  portion  of  variance  in  a  given 
design's  effectiveness.  In  other  words,  choosing  good  baselines  should  reduce  the  risk  to  a  given 
system's  effectiveness.  In  military  systems  the  temptation  to  consider  new  technologies  —  well  beyond 
the  initial  design  phases  —  introduces  a  sizable  risk  to  design  effectiveness.  All  in  all,  it  is  not 
surprising  that  few  complex  system  designs  are  original  or  new.  Rather,  they  typically  are  variants  or 
adaptations  of  existing  designs. 

Effective  design,  therefore,  involves  a  skillful  blending  of  past  baselines  with  new  decisions  and 
tradeoffs,  counterbalanced  to  minimize  risks  to  achieving  pre-defined  functionality  within  material, 
cost  and  schedule  constraints.  Raising  the  efficiency  with  which  information  is  considered  and  factored 
into  dcsi-jn  decision-making  should,  by  inference,  raise  the  probability  of  design  effectiveness. 

Ironically,  enhancing  design  effectiveness  by  improving  design  access  and  utilization  of  design¬ 
relevant  information  may  be  hampered  by  the  fact  that  designers  are  already  deluged  by  too  much 
information  competing  for  their  time  and  attention.  In  a  series  of  studies,  Allen  (12)  has  convincingly 
shown  that  well  over  ninety  percent  (90%)  of  the  information  factored  into  technical  decisions  by 
engineers  already  resides,  at  the  time  it  is  sought,  in  personal  files  or  in  the  files  of  trusted 
colleagues  (Fig  5).  This  observation  is  particularly  interesting  in  view  of  the  information  explosion  in 
a  range  of  technical  areas  of  potential  value  to  system  design.  The  extremely  limited  channel  capacity 
for  consideration  of  new  information  suggested  by  these  data  indicates  that  the  opportunity  for  human 
factors  information  to  impact  system  design  decisions  is,  at  best,  highly  constrained.  More 
specifically,  this  finding  suggests  that  an  optimal  strategy  for  improving  the  impact  of  human  factors 
information  on  system  design  must  focus  on  raising  the  perceived  value  while  lowering  the  perceived  costs 
of  this  information  for  the  system  designer.  Indeed,  simply  understanding  the  key  variables  that  drive 
the  variance  between  perceived  and  actual  values  and  "costs"  associated  with  technical  information  by 
system  designets  should  be  a  principal  area  of  concern  for  human  factors  researchers  and  practitioners. 

Ill  USABILITY  OF  ERGONOMICS 

Achieving  an  optimal  fit  between  system  capabilities  and  the  perceptual  and  performance  capabilities 
of  the  operator  is  dependent  on  a  complex  set  of  factors  dictated  by  the  nature  of  design,  the 
inclinations  and  biases  of  designers,  and  the  availability  of  usable  data  resources.  In  particular, 
human  performance  data  are  needed  in  a  form  and  level  of  precision  that  can  be  traded  off  against  other 
design  variables. 

While  a  good  deal  of  potentially  useful  human  performance  data  exists,  these  data  have  had  very 
little  direct  impact  on  the  design  of  crew  systen  interfaces.  In  large  measure,  the  failure  to  translate 
relevant  research  findings  to  applications  seems  to  lie  with  the  "perceived"  value  of  these  data  in  terms 
of  the  costs  and  risks  in  their  accession,  interpretation  and  efficient  application  to  system  design 
problems. 
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A.  ACCESSIBILITY.  This  refers  to  the  ease  and  precision  by  which  information  may  be  acquired.  Needless 
to  say,  accessibility  is  a  significant  contributor  to  the  perceived  "cost"  of  information  by  designers 
(12).  Hence,  while  it  is  important  that  ergonomics  information  useful  to  a  given  crew  system 
specification  problem  may  exist,  it  is  likely  to  be  embedded  in  a  staggering  volume  of  extraneous 
information  distributed  among  countless  journals,  periodicals,  government  and  industrial  technical 
reports,  etc.  Furthermore,  the  contextual  and  theoretical  fran^works  within  which  researchers  typically 
generate,  disseminate,  and  otherwise  organize  technical  information  are  not  necessarily  cannon  with  the 
logical  framework  or  needs  of  the  practitioner.  For  practical  purposes,  designers  may  not  readily  find 
needed  information  where  it  is  expected  to  be  located  (11). 

B.  INTERPRET  ABILITY.  This  generally  refers  to  the  ease  with  which  information  content  can  be  deciphered 
and  understood.  This  too  is  a  critical  problem  with  traditional  sources  of  human  factors  information  and 
knowledge.  Researchers  typically  feel  little  responsibility  to  the  "applications  world"  beyond  reporting 
their  findings  into  the  scientific  literature.  Hence,  interpreting  &~:3ntific  comunications  will  likely 
add  considerable  overhead  and  in  fact  may  be  a  barrier  for  the  practitioner  in  terms  of  his  or  her 
ability  to  evaluate  the  relevance  of  human  factors  information  to  the  problem  at  hand  (11,13).  The 
human  factors  profession  is  particularly  guilty  of  not  "human  factoring"  the  presentation  of  human 
factors  data  for  practitioners  (14). 

C.  APPLICABILITY.  A  major  contributing  problem  to  the  usability  of  human  factors  are  the  obvious 
difficulties  and  continuing  controversy  regarding  the  relevance  and  translatabi  1  ity  of  research  data  to 
practical  applications  (15,16).  Independent  of  the  highly  controlled  circunstances  under  which  data  are 
collected,  the  experimental  conditions  posed  by  researchers  are  often  so  synthetic  that  it  requires  a 
major  stretch  of  the  imagination  to  find  analogous  circumstances  in  the  real  world  to  which  these 
conditions  might  relate.  The  concern  is  that  data  collected  under  such  highly  limiting  conditions  cannot 
be  reasonably  extrapolated  to  multivariate  conditions  where  many  contributions  to  variance  from 
interaction  effects  ronain  unaccounted  for.  Unfortunately,  this  criticism  is  also  true  of  most  applied 
multivariate  studies  in  which  the  problems  of  compatision  and  extrapolation  between  experimental  and 
dynamic  "real  world"  contributors  to  variance  are  severely  compounded.  Therefore,  if  one  gauges  the 
applicability  of  ergonomics  based  solely  on  the  assumption  that  it  is  to  be  used  by  designers  seeking 
"cookbook"  answers,  then  ergonomics  as  a  viable  discipline  is  doomed  to  failure.  Neither  the  time  nor 
resources  are  ever  likely  to  exist,  particularly  in  the  midst  of  design  problem  solving,  to 
parametrically  evaluate  (with  any  certainty)  the  conditions  active  in  an  interactive  real  world  system 
problem  117).  The  usefulness  of  these  data  seems  to  lie  not  so  much  with  their  direct  translatabi  1  ity  to 
multifactor  conditions  (though  some  "cookbook"  answers  exist  for  some  "cookbook"  questions),  but  rather 
with  their  use  as  an  aid  or  means  to  answering  questions  by  providing  cues,  clues  and  confirmations 
supportive  of  the  designer’s  reasoning  processes. 

Designers  commonly  decompose  design  problems  (e.g.  systems  to  subsystems  as  in  Fig.  6;  Ref  18)  into 
logical  subsets  of  design  questions  and  tradeoffs  while  attempting  to  hold  associated  risks  constant 
through  baselining  (Fig  7).  Depending  on  factors  such  as  the  availability  of  "cookbook"  answers,  high 
value  issues  for  which  uncertainty  remains  may  be  further  decomposed  into  higher  resolution  questions  for 
which  the  "best"  answers  within  time  and  resource  constraints  will  be  sought.  The  process  of  generating 
higher  resolution  questions  and  matching  to  the  best  resolution  answers  probably  involves  informal 
theorizing,  pattern  recognition,  analogical  reasoning  and  other  processes  all  ol  which  may  be  subsumed  as 
design  "intuition"  and  creativity  (19).  Hence,  for  example,  designers  of  controls  and  displays 
frequently  ask  questions  of  human  factors  practitioners  in  which  the  variables  of  interest  are  highly 
constrained  (20).  While,  in  many  instances,  this  may  facilitate  a  "direct"  match  to  the  empirically 
based  research  literature,  more  often  than  not,  matches  to  the  extant  data  are  made  on  the  basis  of 
inferences,  the  seeking  of  cues  or  clues,  or  in  the  confirmation  of  informal  predictions. 

It  is  interesting  to  note  that  while  this  process  is  not  well  understood,  it  is  also  somewhat 
analogous  to  that  followed  by  researchers  in  the  piloting  phase  of  research  when  they  are  seeking  the 
"sweet  spot"  among  the  variables  of  interest  to  study.  Though  this  phase  of  research  is  rarely  treated 
explicitly  in  the  empirical  literature,  it  clearly  involves  skills  critical  to  good  research  — 
independent  of  our  current  state  of  understanding  of  the  processes  which  govern  it.  Similarly,  examples 
of  ’good'  human  engineering  abound  in  which  the  supporting  rationale  for  key  decisions  or  tradeoffs  is 
nothing  more  than  an  artifact  of  retrospective  reasoning.  Perhaps,  therefore,  the  major  differentiating 
element  between  "good"  researchers  and  "good"  designers  is  that  researchers  are  compelled  to  formalize 
their  observations  of  causes  and  effects  in  a  procedural  context  while  designers  find  satisfaction  in  the 
informal  confirmation  of  their  inferences  and  predictions  in  the  "trial  and  error"-like  synthesis  of  a 
design. 

The  "bottom  line"  to  this  discussion  is  that  while  much  apparently  relevant  ergonomics  information 
exists,  its  application  to  system  design  problems  is  not  at  all  straightforward.  It  is  difficult  to  use 
as  a  basis  for  prediction  and  its  use  carries  many  risks  for  the  designer.  Coupling  this  difficulty  with 
the  risks  associated  with  its  accession  and  interpretation  severely  reduces  its  perceived  value  to  the 
system  designer.  The  successful  matchinq  of  crew  system  specifications  to  human  performance  capabilities 
is  ultimately  dependent  on  (1)  raising  the  absolute  value  and  lowering  the  costs  of  ergonomics  in  system 
design  while  (2)  manipulating  the  perceived  value  and  costs  of  this  knowledge  within  the  crew  system 
design  community.  The  first  issue  is  dependent  on  a  reassessment  of  responsibilities  and  roles  within 
the  profession.  By  this,  I  mean  an  assumption  by  the  profession  of  greater  responsibility  in  closing  the 
gap  between  responsive  research  and  application  needs  while  effecting  a  shift  in  focus  toward  developing 
the  models,  methods  and  metrics  needed  to  transition  the  state-of-the-art  of  luman  engineering  knowledge 
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and  practice  to  the  system  design  process.  The  fact  that  this  is  beginning  to  happen  in  conjunction  with 
concerted  attempts  at  consolidating  and  institutional izing  the  ergonomics  knowledge  base^'^  leads  me  to 
believe  that  the  perceived  values  and  costs  of  ergonomics  in  system  design  should  naturally  begin  to 
shift  in  response.  Facilitating  this  shift  in  the  US  are  major  changes  in  DOD  system  acquisition 
policies  which  are  placing  new  emphasis  on  requirements  for  human  factors  specification  (e.g.  MANPRINT  in 
the  US  Army;  Manpower,  Personnel  and  Training  System  Project  Office  in  the  US  Air  Force).  Qnerging 
information  access  and  decision  support  system  technologies  integrated  into  computer  aided  design  and 
engineering  systans  (CAD  CAM)  such  as  the  AF  Cockpit  Autonation  Technology  Program,  the  AF  Designer's 
Associate  and  the  Army /NASA  C*I  Program  will  eventually  aid  future  designers  to  efficiently  access  and 
tradeoff  honan  performance  data  with  other  technical  information  germane  to  the  effective  design  of  crew 
systems. 

IV.  CONCLUSIONS 

Matching  system  specifications  to  human  performance  capabilities  and  limitations  has  acquired  greater 
legitimacy  as  a  design  goal  for  future  crew  system  interfaces.  Meeting  this  goal  with  respect  to  human 
sensory,  perceptual,  cognitive  and  psychcmotor  capabilities  cannot  presently  be  achieved  in  a  systematic 
fashion  employing  traditional  engineering  practice.  The  problem  results  from  the  costly  accessibility  and 
uncertain  applicability  of  ergonomics  data  coupled  with  the  conservative  inclinations  of  system  designers 
and  the  cost/schedule  pressures  of  the  acquisition  process.  In  the  past,  the  perceived  gain  of  using 
ergonomics  has  been  too  low  given  the  costs  (time,  money  and  risks)  of  accessing  and  practically  applying 
this  information  in  the  system  design  process.  The  emergent  availability  of  application-oriented  data 
sources,  access  and  decision  support  system  technologies  and  shifts  toward  regulatory  demand  for 
ergonomics  in  the  DoD  system  acquisition  process  will  collectively  raise  the  value  for  designers  of 
factoring  ergonomics  into  system  design. 


^  There  is  a  critical  need  to  distill  and  consolidate  useful  human  factors  knowledge  so  that  it  may  be 
available  as  a  resource  designers.  A  sianiri--o.it  effort  in  this  vein  is  the  Integrated 

Perceptual  Information  for  Designers  (IPID)  Project  which  is  a  US/NATO  AGARD  multiagency  supported  effort 
to  develop  hunan  performance  data  resources  for  system  designers.  IPID  has  supervised  the  review  and 
evaluation  of  many  thousands  of  research  studies.  The  small  percentage  rated  as  reliable  and  applicable 
has  been  consolidated  and  packaged  into  a  variety  of  conmunications  media.  The  first  is  a  two  volume 
reference  Handbook  of  Perception  and  Human  Performance  (21,22)  for  hunan  factors  specialists.  Second  is 
a  four- volume  Engineering  Data  Compendium  (23)  in  which  the  presentation  of  these  data  has  been  human- 
factored  to  enable  their  direct  use  by  system  designers.  IPID  is  also  sponsoring  and  developing 
educational  opportunities  to  train  and  sensitize  system  designers  in  the  value  and  application  of  human 
performance  data  to  crew  systan  design. 

^  The  Crew  System  Ergonomics  Information  Analysis  Center  (CSERIAC).  Under  the  auspices  of  the  DOD  and 
in  conjunction  with  the  Tri-services  and  NASA,  the  AAMRL  will  establish  and  host  in  mid-1988  an 
institute  with  responsibility  for  the  maintainance,  update  and  analysis  of  ergonomic  knowledge  resources 
needed  to  support  crew  systsn  design  (24).  CSERIAC  will  provide  a  full  range  of  technical  information 
services  in  support  of  crew  system  research,  design  and  development  serving  the  government,  and 
industrial  and  academic  sectors  in  the  US  and  abroad.  The  key  function  of  CSERIAC  will  be  to  build  a 
network  among  relevant  experts  and  other  knowledge  sources  while  developing  the  resources  and  media  to 
draw  upon  and  focus  this  expertise  to  solve  problems,  achieve  expert  concensus,  and  aid  planning  for  more 
effective  use  of  ergonomics  data  in  the  system  design  process. 
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Artist  rendition  of  AAMRL  virtual  crew  system. 


Process  schematic  of  design  decision  making. 
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METHOD  OF  FORMAL  LITERATURE 
ACQUISITION  EMPLOYED  BY  ENGINEERS  ON 
TWELVE  DEVELOPMENTAL  PROJECTS 
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5.  Information  acquisition  by  engineers.  Adapted  frcni  Allen. 
1976. 
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6.  system/subsystem  decomposition  for  an  aircraft  flight 
simulator. 
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7.  Schematic  showing  Different  levels  to  which  a  design  problem 
may  be  decomposed.  As  system  issues  are  decomposed  to  finer 
subsets,  there  is  a  cor  respond  ir>j  proliferation  of  subsystem 
issues  (as  shown  in  fig.  6)  with  questions  and  tradeoffs  to 
resolve.  The  level  to  which  a  given  design  problem  is  reduced  is 
dependent  upon  the  availability  of  usable  baselines,  technical 
information  resources  and  the  degree  of  risk  to  system 
effectiveness  associated  with  resolvinj  a  given  issue.  Th*> 
process  of  resolving  questions  or  issues  at  a  given  level  of 
resolution  using  the  "best  answers"  oflered  by  available  technical 
resources  is  not  well  understood.  Neither  do  we  understand  the 
collective  re- integration  or  synthesis  of  these  responses  within 
and  across  individuals  which  contributes  to  resolving  the  broader 
levels  of  issues  and  tradeoffs  in  a  given  design. 
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ABSTRACT  -  The  Integrated  Control  and  Avionics  for  Air  Superiority  (ICAAS)  Program  is  a 
United  States  Air  Force  Advanced  Development  Program  to  design,  develop,  and  demonstrate 
selected  fighter  aircraft  technologies  needed  to  kill  and  survive  when  outnumbered  in  air 
combat  engagements.  Design  emphasis  is  placed  upon  functional  integration  of  sensors, 
fire  control,  flight  control,  weapons  and  interface  with  the  pilot  to  achieve  improved 
b ey^nd-v isua 1- range  (8VR)  multiple  target  attack  capability  with  effective  transition  to 
close-in  combat  (CIC)  .  Data  from  multiple  onboard  sensors  is  blended  for  improved  target 
detection,  track,  and  identification  functions.  Fire  control  algorithms  compute  multiple 
target  prioritizations  and  missile  launch  solutions  using  active  or  passive  sensor  modes. 
Flight  control  algorithms  Include  attack  and  defensive  guidance  functions  which  aid  the 
pilot  in  maximizing  launch  opportunities  while  minimizing  threat  exposure.  Evasive 
maneuvers  with  countermeasures  ire  used  to  survive  attack  by  threat  homing  missiles. 
Improved  cockpit  presentation  i  engagement  data  enhances  pilot  situation  awareness  to 
allow  informed  engagement  decisions.  Data  link  internetting  between  friendly  aircraft 
reduces  dependency  on  verbal  communication  and  greatly  enhances  intraflight  coordinated 
attack.  Piloted  simulations  and  flight  testing  will  be  used  to  develop  and  validate  ICAAS 
technology  in  a  realistic  multitarget  environment.  This  paper  presents  details  of  the 
ICAAS  concept  and  design  approach. 

l_NT_RODUCT T ON  -  Recent  literature  is  filled  with  descriptions  of  an  increasingly  complex 
air  combat  environment  which  will  challenge  the  ability  of  USAF  tactical  fighter  aircraft 
forces  to  establish  and  maintain  air  superiority.  Fxperts  generally  agree  that  enemy 
forces  will  have  a  significant  numerical  advantage.  According  to  Col  Jeffrey  G.  Cliver, 
Chief  of  the  Tactical  Division  at  che  Directorate  of  Operations,  Hq  USAF,  "In  the  next 
war  we  could  be  outnumbered  by  six  or  more  to  one  in  any  given  air  battle"  (11.  Current 
USAF  operational  fighter  aircraft  arc  very  effective  in  attacking  single  targets,  but 
sensor,  weapon  and  subsystem  design  limitations  inhibit  performance  capability  against 
multiple  targets,  especially  at  beyond-visual-rsnge  (RVR).  Onboard  sensors  seldom  provide 
sufficient  Information  to  detect  all  potential  threats  or  to  idencify  non-cooperative 
targets.  The  pilot  must  visually  confirm  i  tie  n  t  i  f  ica  t  i  on  ,  thus  forcing  him  into  sh  *.  t 
range  dogfight  situations  where  a  numerically  superior  force  usually  has  the  advantage. 
Serai-active  missiles,  such  as  the  AIM-7,  require  continuous  radar  coverage  In  radar  single 
target  track  mode  ail  the  way  from  launch  Co  target  arrival.  This  allows  only  the  highest 
priority  target  to  be  attacked,  at  any  given  time.  If  a  pilot  is  surprised  by  a  higher 
priority  threat  during  a  missile  fly  out,  he  must  abandon  radar  illumination  of  the 
original  target  resulting  in  the  missile  going  ballistic.  Dedicated  control  ard  display 
formats  for  each  subsystem  force  the  pilot  to  mentally  Integrate  data  at  hand  to  assess 
the  situation  and  make  engagement  decisions.  Communication  with  friendly  aircraft  using 
r.dlo  conversation  is  time  consuming  to  the  pilot  and  very  prone  to  errors  as  messages 
become  garbled  with  multiple  aircraft.  For  all  these  reasons,  attacking  pilots  attempt  to 
isolate  and  engage  single  targets  one  at  a  time.  The  primary  commandment  of  air-to-air 
warfare  is:  "If  at  all  possltt**,  engage  only  if  you  have  the  advantage.  This  means  that 
a  flight  of  two  always  attempts  to  engage  a  single  bogey"  (1).  This  tactic  can  be  used 
very  effectively  to  counter  an  enemy  force  of  limited  numbers,  but  when  the  enemy  has  a 
significant  numerical  advantage,  major  improvements  in  onboard  system  capabilities  are 
needed.  Multiple  targets  and  threats  must  be  addressed  simultaneously,  with  different 
actions  appropriate  to  each,  rather  than  a  series  of  actions  against  a  single  target.  As 
stated  by  Col  Hoffman  (2),  "Clearly  the  challenge  for  our  future  fighters  remains  with  our 
ability  to  build  in  the  technology  to  counter  a  numerically  superior  enemy". 

New  technology  developments  are  taking  place  which  will  provide  tactical  fighter  pilots 
with  much  needed  system  enhancements.  Advanced  sensors  will  provide  greater  accuracy  in 
surveillance  and  target  recognition  (3).  For  example,  infrared  sensors  can  augment  radar 
by  providing  target  position  data  without  emitting  signals  which  can  be  detected  by 
electronic  countermeasures.  The  Advanced  Medium-Range  Alr-to-Air  Missile  (AMRAAM)  will 
allow  a  fighter  to  engage  several  enemy  Aircraft  at  the  same  time,  since  constant  target 
illumination  is  not  required  (4).  Advanced  countermeasures  will  provide  additional 
information  about  the  enemy  and  reduce  the  effectiveness  of  his  onboard  systems.  Digital 
data  internetting  will  provide  an  Intraflight  exchange  of  situation  data  and  target 
assignments  without  depending  on  voice  communications.  Increases  in  onboard  computer 
powe,  will  enhance  data  processing  capacity.  These  are  only  a  few  of  many  ongoing 
developments,  but  enough  to  make  an  important  pofnt.  Future  fighter  aircraft  will  be 
capable  of  generating  an  enormous  amount  of  data  from  a  multitude  of  subsystems.  However, 
more  oust  be  done  to  help  a  pilot  manage  these  subsystems,  derive  critical  situation 
information  and  sort  out  the  best  engagement  options  to  consistently  engage  and  defeat  a 
larger  enemy  force.  This  cannot  be  accomplished  with  a  collection  of  independent  or 
self  contained  subsystems.  Integiated  con f i gu r a t  i  ons  must  be  developed  with 
capabilities  to  provide  the  pilot  with  a  summary  assessment  of  the  combat  situation, 
recommended  engagement  options,  and  automatic  execution  of  tasks  requested  by  the  pilot. 
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The  ICAAS  program  was  originated  to  address  these  design  challenges.  The  program  is 
sponsored  by  the  Air  Force  Wright  Aeronautical  Laboratories,  Wright-Patteraon  AFB ,  Ohio. 
Development  activity  will  be  divided  into  three  major  categories;  attack  management, 
flight  management,  and  pilot/vehi cle  interface.  The  Flight  Dynamics  Laboratory  will  be 
responsible  for  overall  program  management,  with  attack  management  development  and 
integration  support  from  the  Avionics  Laboratory.  Flight  testing  will  be  performed  at  the 
Air  Force  Flight  Test  Center,  Edwards  AFB,  California.  Contracts  for  system  development 
were  not  yet  announced  at  the  time  of  this  publication.  This  paper  discusses  content  of 
the  three  ICAAS  development  areas  followed  by  the  program  approach  to  system  Integration 
and  test  and  evaluation. 

Attack  Management  -  Algorithms  are  being  developed  which  form  an  interface  between  the 
pilot  and  the  onboard  sensors  and  weapons.  The  purpose  is  to  provide  the  pilot  with 
information  to  maintain  a  high  level  of  situation  awareness.  These  algorithms  will 
perform  functions  of  a)  sensor  control,  b)  data  fusion,  c)  weapon  control  and  d) 
internetting  (intraflight  data  exchange). 

a.  Sensor  Control  -  Pilot  workload  associated  with  the  task  of  sensor  control  can  be 
extremely  high.  A  modern  radar  can  have  more  than  twenty  different  operating  modes  and  a 
pilot  can  easily  dedicate  most  of  his  attention  to  operating  the  radar.  Most  pilots  will 
become  familiar  with  some  of  the  modes  and  ignore  the  rest.  Since  future  fighters  will 
likely  have  multiple  sensors,  it  is  easy  to  see  how  the  pilot  of  a  single  seat  aircraft 
could  easily  become  overwhelmed  with  manually  operated  sensors.  ICAAS  automated  sensor 
control  will  support  particular  attack,  modes  desired  by  the  pilot,  including  active  mode 
with  sensor  energy  emissions  allowed  (such  as  radar),  low  probability  of  intercept  mode 
with  limited  energy  emissions  allowed,  and  covert  mode  with  use  of  only  non-emitting 
sensors  (such  as  infrared).  Individual  sensor  functions  such  as  on/off  switching  and 
sensor  pointing  are  Included,  with  provisions  for  pilot  manual  control  whenever  necessary. 
Coordinated  use  of  multiple  sensors  allows  maximum  total  scan  volume  coverage  (see  figure 
1)  or  other  control  strategies  depending  on  needs  driven  by  the  battle  scenario. 


FIGURE  l 

b.  Data  Fusion  -  Any  individual  sensor  may  not  be  able  to  assemble  all  desired  data 
concerning  a  particular  target,  especially  for  confirming  positive  i den t i f ica r ion  of  BVR 
non-cooperative  targets.  ICAAS  data  fusion  algorithms  combine  track  file  data  from 
multiple  sensors  to  derive  a  total  summary  of  known  target  characteristics,  resulting  in  a 
much  higher  probability  of  identification.  Another  valuable  output  of  data  fusion  is  a 
target  kill  assessment.  It  is  important  for  a  pilot  to  establish  whether  a  BVR  missile 
launch  killed  the  intended  target.  If  so,  he  may  turn  his  attention  to  other  potential 
threats.  But,  if  the  target  was  not  destroyed,  he  may  become  vulnerable  to  attack  from 
the  original  target  by  redirecting  his  attention.  Data  fusion  from  multiple  sensors 
improves  confidence  in  the  kill  prediction;  if  both  an  infrared  flash  Is  detected  at 
expected  missile  Impact  time  and  radar  velocity  goes  to  zero,  a  kill  is  highly  probable. 

c.  Weapon  Control  -  Baseline  weapons  for  ICAAS  fire  control  system  functions  are 
AMRAAM,  AIM-9,  and  T5mm  gun.  Data  from  target  track  files  are  used  to  compute  ownship 
missile  launch  envelopes  and  threat  envelopes  against  the  ownship.  In  addition, 
recommended  target  priorities  will  be  established  considering  such  factors  as  weapon 
status  (quantity  &  type),  relative  geometry  to  the  enemy  aircraft,  guidance  requirements 
of  in-flight  missiles,  and  pilot  designation  of  priority  target.  Fire  control  algorithms 
enable  simultaneous  launch  against  several  targets,  with  appropriate  post-launch  guidance 
provided  to  the  missiles.  An  all-aspect  director  type  gunsight  is  available  to  take 
advantage  of  gun  opportunities  if  the  engagement  collapses  to  close-it  combat. 

Finally,  the  pilot  can  use  information  provided  to  make  decisions  on  how  to  attack  and  how 
much  automation  to  allow  from  the  onboard  weapons  control. 

d.  Internet  t lng  -  Intraflight  digital  data  link  capability  will  be  implemented  to 
permit  exchange  of  sensor  data  (track  files),  targeting  assignments  and  tactics.  ThiB 
allows  extension  of  data  fusion  algorithms  to  Include  known  target  data  from  all 
cooperative  sensor  sources.  A  sample  benefit  of  this  approach  is  the  case  of  a  covert 
attack  using  an  Infrared  (IR)  sensor.  A  single  1R  sensor  can  precisely  measure 


1 ine-o f - s i gh t  to  a  target,  but  cannot  directly  determine  target  range.  To  get  an 
accurate  range  measurement,  a  burst  of  radar  energy  may  be  required  and  the  target  may 
be  alerted.  Two  internetted  fighters  can  triangulate  using  line  of  sight  measurements 
to  accurately  determine  target  range  while  remaining  covert.  In  addition,  all 
internetted  fighters  get  a  consolidated  summary  of  situation  data  and  indication  of 
targeting  assignments.  Fighter  effectiveness  will  increase  dramatically  compared  to 
coordination  using  voice  communications.  The  1CAAS  program  is  not  developing  data  link 
technology,  only  developing  functions  which  depend  on  its  presence. 

Flight  Management  -  1CAAS  flight  management  involves  guidance  and  control  of  a  fighter 
aircraft  during  the  engagement  mission  phase  to  achieve  combat  positional  advantage. 

The  previously  discussed  attack  management  algorithms  will  only  provide  the  pilot  a  high 
level  of  situation  awareness.  When  a  flight  is  opposed  by  superior  numbers  of  enemy 
aircraft,  the  best  engagement  option  of  several  alternatives  may  not  be  obvious,  and 
more  than  just  good  situation  awareness  is  required.  Flight  management  algorithms 
consider  factors  relevant  to  planning  and  executing  flight  trajectories  which  position 
the  aircraft  for  maximum  probability  of  target  kill  and  maximum  probability  of  ownship 
survival.  Flight  trajectory  information  must  be  displayed  to  the  pilot  for  manual 
control,  or  coupled  to  the  flight  control  system  for  automatic  flight.  The  level  of 
automation  needed  to  achieve  Che  most  effective  combat  performance  is  a  critical  Issue 
to  be  examined  throughout  the  ICAAS  program.  In  any  case,  the  pilot  must  be  able  to 
alter  the  recommended  solution. 

Due  to  the  extremely  dynamic  nature  of  air  combat,  computation  of  flight  trajectories 
within  appropriate  time  constraints  is  a  significant  design  challenge.  The  design  must 
minimize  decision  errors  due  to  incomplete,  Imprecise,  or  false  sensor  information. 

Control  solutions  must  remain  unpredictable  to  the  enemy  yet  reactive  to  enemy  actions. 
Defensive  flight  maneuvers  enhance  survival  against  threat  homing  missiles  by  properly- 
timed  evasive  maneuvers  in  conjunction  with  use  of  expendable  or  electronic 
countermeasures.  Offensive  and  defensive  trajectory  computations  must  be  properly- 
balanced  so  that  attack  can  be  executed  with  defensive  contingencies  In  mind,  ar.d 
defensive  maneuvers  can  be  implemented  without  abandoning  an  offensive  posture. 

Flight  management  algorithms  must  interact  with  attack  management.  In  many  cases  flight 
management  information  affects  attack  management  target  prioritization  solutions.  For 
example,  when  assigning  attack  priorities  for  enemy  aircraft,  higher  priority  should  be 
assigned  to  aircraft  which  are  in  a  position  to  defeat  defensive  maneuvers.  Flight 
management  must  also  consider  wingmen  status  and  shared  data  sources  which  are  available 
from  the  internetting  function  of  attack  management.  Mutual  support  from  cooperating 
fighters  will  enhance  overall  effectiveness.  Specific  functions  of  ICAAS  flight 
management  include: 

a)  “  A  precision  navigation  capability  is  being  developed  for  computing 
ownship  inertial  position  and  state  information  (attitude,  velocity,  acceleration,  etc) 
throughout  the  time  of  flight.  A  common  source  of  state  date  is  used  for  navigation 
computations,  flight  control  inputs,  s t ab i 1 iz a t ion / cor re  1  a r  Ion  of  multiple  target 
sensors,  and  fire  control  calculations  of  missile  launch  envelopes.  This  supports 
efficient  functional  integration  while  reducing  the  required  number  of  onboard  motion 
sensors. 

b)  A£  t  a  c  k_T  e££o  r  £  "  Algorithms  provide  the  pilot  with  mu  1 1 i p 1 e - 1 a r ge t  attack 

trajectory  control  references  and  recommended  control  solutions  which  can  be  coupled  to 
the  flight  control  system.  Automatic  control  modes  shall  be  activated  only  by  positive 
pilot  action.  BVR  attack  trajectories  are  based  upon  avoiding  threat  launch  zones  while 
solving  ownship  missile  launch  constraints.  Transition  to  CIC  includes  a  precision  weapon 
pointing  control  system  for  short  range  missiles  and  aerial  gunnery. 

c)  A^r  f  r  ame_Pe  r£orin£inc  e  “  Flight  management  aids  the  plLot  In  maintaining  aircraft 
performance  which  is  appropriate  for  the  combat  situation.  Energy  Maneuverability  (EM) 
information  permits  full  exploitation  of  aircraft  maneuver  potential  to  achieve  combat 
positional  advantages.  EM  will  relate  current  state  conditions  to  available  maneuver 
potential  and  compute  the  best  combination  of  altitude,  airspeed,  power  setting,  etc.  to 
minimize  a  mission  critical  component  of  airframe  performance.  For  example,  a  pilot  raav 
desire  to  fly  to  an.  energy  state  which  provides  maximum  launch  range  for  a  medium  range 
missile,  then  quickly  transition  to  conditions  for  optima]  endgame  evasive  maneuvering. 
McAtne  (5)  has  emphasized  the  Importance  o t  an  aircraft's  ability  to  rapidly  transition 
from  one  flight  condition  to  another,  rattier  than  attempting  to  maintain  greatest  energy- 
state.  In  other  situations,  the  pilot  may  want  to  present  minimum  radar  cross  section  or 
infrared  signature  to  a  particular  enemy  aircraft.  He  may  want  to  fly  a  minimum  time  or 
minimum  fuel  intercept  trajectory.  These  are  examples  of  conditions  which  are  being 
investigated  during  ICAAS  flight  management  development.  Modes  which  are  implemented  will 
be  prioritized  by  the  expected  payoff  in  combat  performance.  In  any  case,  the  flight 
management  Implementation  will  assist  the  pilot  in  sorting  feasible  from  infeasible 
engagement  options  and  optimizing  aircraft  performance  appropriately. 

d)  Mi  as  1  j_e_Avo  idance  /  Evas  ion  -  Studies  have  shown  that  precisely  timed  and  controlled 
endgame  evasive  maneuvers  can  defeat  attack  by  a  threat  homing  missile  (6).  ICAAS  flight 
management  computes  avoidance  and  evasion  flight  trajectories  for  pilot  manual  nr 
automatic  control.  Avoidance  maneuvers  are  defined  as  actions  prior  to  threat  missile 
launch,  or  early  In  the  missile  time  of  flight,  which  are  intended  to  fly  the  aircraft  to 
a  safe  location  beyond  the  missile  flight  envelope.  Mid-course  or  endgame  maneuvers  are 
performed  to  create  a  safe  miss  distance  when  avoidance  is  not  possible  (see  figure  2)  . 
Information  from  ownship  and  internetted  sensors  is  used  to  gather  Information  about  the 


Inbound  missile  and  to  compute  appropriate  defensive  maneuvers.  Coordinated  use  of 
available  countermeasures  provides  greater  miss  distance  than  possible  with  maneuvering 
alone.  Significant  increases  in  probability  of  survival  are  expected  compared  to  manually 
flown  "rule  of  thumb"  defensive  maneuvers  which  pilots  are  forced  to  use  at  present. 


FIGURE  2 

e)  Resource  Management  -  Available  onboard  resources  are  considered  when  computing 
ICAAS  flight  trajectories.  Resources  are  defined  as  weapons,  fuel,  and  countermeasures. 
For  example:  a)  the  pilot  will  be  informed  if  a  minimum  time  intercept  trajectory  would 
exhaust  his  available  fuel  supply,  b)  if  all  medium  range  missiles  have  been  expended,  BVR 
attack  trajectories  would  be  discarded  in  favor  of  CIC  weapons  or  egress  from  the 
pngagement,  c)  missile  evasion  algorithms  should  not  consider  an  option  for  dispensing  a 
flare  against  an  infrared  missile  if  all  flares  have  been  expended. 

Pilot/ Vehicle  _Ijjter_faee  -  Pilots  make  decisions  based  on  perceived  information,  so  by 
obtaining  more  complete  Information  and  presenting  it  more  concisely,  situation  awareness 
can  be  improved,  and  the  best  engagement  decisions  made.  Techniques  are  being  developed 
to  display  both  ownsbip  and  supporting  aircraft  status.  Pilots  may  then  make  appropriate 
decisions  in  coordination  with  friendly  aircraft.  For  instance,  display  of  targets 
designated  by  other  friendly  aircraft  reduces  the  probability  of  two  pilots  attacking  the 
same  target  funless  help  is  requested). 

Significant  cockpit  design  issues  must  be  addressed  to  enable  a  pilot  to  maintain 
situation  awareness  with  reasonable  workload  in  complex  aerial  engagements.  Efficient 
data  management  techniques  must  be  utilized  to  provide  timely  and  relevant  information  in 
a  format  easily  understood  by  the  pilot.  The  p i lo t / veh ic 1 e  interface  (PVI)  must  be 
integrated  with  the  rest  of  the  aircraft  to  achieve  the  necessary  data  transfer  efficiency 
and  resulting  pilot  effectiveness.  The  ICAAS  program  is  examining  cockpit  control/display 
features  and  automation  versus  manual  task  allocation  to  define  an  advanced  air-to-air 
cockpit  design.  Color  multifunction  displays  will  be  used  to  present  tactical  situation 
data,  weapon  delivery  information,  threat  warnings,  and  recommended  flight  trajectories. 

A  helmet  mounted  sight/display  is  being  used  for  sensor  cueing  and  threat  warning. 
Interactive  voice  control  Is  used  as  an  alternate  to  manual  control  for  functions  such  as 
primary  mode  selection,  display  control,  and  data  requests.  All  of  these  crew  system 
technologies  are  planned  for  ICAAS  flight  demonstration. 

A  major  ICAAS  goal  is  to  provide  functional  harmony  between  the  pilot  and  the  advanced 
attack  and  flight  management  algorithms.  The  amount  of  automation  that  a  pilot  needs, 
such  as  recommended  engagement  decisions  and  automatic  control  coupling  is  an  Important 
issue.  According  to  Moss  (8),  this  depends  upon  the  kind  of  task  and  level  of  pilot 
performance.  A  task  such  as  BVR  target  identification  must  be  automated  because  the 
pilot  cannot  contribute  to  the  process.  Automated  defensive  maneuvers  in  response  to  a 
threat  homing  missile  may  be  automated,  with  pilot  consent,  due  to  the  precision  control 
and  timing  requirements.  Offensive  attack  steering  is  a  task  where  the  pilot  might  best 
apply  his  inherent  flying  skills.  A  proper  balance  of  manual  and  automatic  task 
allocation  will  be  required  to  achieve  the  desired  combat  performance. 

I n_t 1 1  on  -  The  ICAAS  program  Is  emphasizing  system  Integration  as  a  technology, 
not  Just  an  implementation  detail,  thereby  leading  to  higher  system  performance  levels 
through  synergistic  combination  of  information.  Integration  is  an  interactive  process 
which  begins  with  concept  definition  and  is  continued  through  final  testing.  Complex 
interactions  between  attack  and  flight  management  functions  and  interfaces  with  sensors 
and  weapons  must  be  Identified  This  process  is  not  complete  until  both  known  and  unan¬ 
ticipated  problems  are  solved.  To  accomplish  this,  s  well  structured  test  environment  is 
required  to  control  the  number  of  variables  at  each  integration  step  for  isolation  of 


FIGURE  3 

Software  development  and  integration  is  a  major  task  within  the  TCAAS  Program.  The 
Department  of  Defense  standard  Ada  software  language  is  being  used  for  all  software 
development.  Use  of  Ada  is  expected  to  reduce  software  development  cost,  provide  better 
insight  to  the  integration  process,  and  maximize  technology  transition  opportunities. 

Past  and  ongoing  flight  demonstrations  of  flight  critical  software  in  the  Ada  language 
have  provided  sufficient  confidence  that  Ada  is  suitable  for  the  ICAAS  Program  (9). 

Hot  bench  and  hardwa  re -in- the -loop  simulation  testing  is  being  used  to  integrate  software 
and  hardware  components.  The  total  system  must  perform  according  to  design  specifications 
and  must  operate  in  real  time.  Pilots  evaluate  the  ICAAS  system  as  it  matures,  to  assure 
information  is  presented  in  a  manner  resulting  in  effective  decision  making  with 
acceptable  workload. 

Test  and  Evaluation  -  The  primary  objective  of  ICAAS  test  and  evaluation  is  to  demonstrate 
feasibility  and  performance  capabilities  of  the  ICAAS  technologies.  The  overall 
performance  goal  is  a  ten  to  one  kill  ratio  when  outnumbered  by  four  times  as  many  enemy 
aircraft.  Capabilities  of  enemy  forces  are  based  on  1995  projections.  Pilot  in  the 
loop  simulation  and  flight  test  experiments  are  used  to  evaluate  ICAAS  performance  in 
realistic  air  combat  environments  (see  figure  4). 

SIMULATION  FLIGHT  TEST 


FINAL  DESIGN 
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Formal,  high  fidelity.  Interactive  piloted  simulation  will  he  conducted  to  measure  the 
combat  performance  of  four  lnternetted  ICAAS  aircraft  engaging  up  to  sixteen  enemy  (red) 
aircraft.  An  orderly  buildup  in  complexity  is  expected,  starting  with  two  blue  versus  two 
red.  Blua  aircraft  utilize  two  cockpit  domes  which  include  crew  stations  fully  configured 
with  ICAAS  controls,  displays,  and  information  processing.  Out  of  cockpit  visual  scenes 
include  threat  and  friendly  aircraft,  appropriate  sky/earth  references,  and  missiles. 
Manned  stations  are  used  to  represent  the  remaining  two  blue  aircraft.  Red  forces  consist 
of  an  equal  number  of  manned  stations  and  digital  aircraft  models.  Test  conditions 
include  a  variety  of  realistic  mission  scenarios. 

An  advanced  baseline  sensor  suite  is  being  modelled  during  the  ICAAS  simulations.  The 
baseline  suite  consists  of  a  multi-mode  radar  with  an  Electronically  Steerable  Antenna 
(ESA),  Infrared  Search  and  Track  System  (IRSTS),  Laser  Tracker/Ranger  (LTR)  ,  Radar  Warning 
Receiver  Fire  Control  Interface  Software  (RFIS),  Airborne  Self  Protection  Jammer  (ASPJ), 
MissiLe  Warning  System  (MWS) ,  Joint  Tactical  Information  Distribution  System  (JT1DS), 
Identification  Friend  or  Foe  (IFF),  Global  Positioning  System  (GPS),  and  Inertial 
Navigation  Assembly  (INA).  Tradeoff  studies  refine  this  baseline  into  a  final  sensor 
configuration  which  results  in  the  most  effective  combat  performance.  Realistic  sensor 
configurations  and  capability  limitations  force  attack  and  flight  management  algorithms  to 
cope  with  less  than  perfect  situation  information. 

Flight  testing  will  demonstrate  that  ICAAS  system  algorithms  can  be  hosted  on  a  testbed 
fighter  aircraft  and  Integrated  with  actual  sensor  derived  target  data  while  operating 
in  realistic  flight  conditions.  Capabilities  to  effectively  handle  simultaneous  events 
needed  to  fight  and  win  when  outnumbered  will  be  exercised.  Complete  encounters  will  be 
performed  with  the  ICAAS  testbed  aircraft  versus  up  to  four  aggressor  aircraft,  as 
depicted  in  figure  5. 
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Engagements  will  be  initiated  at  BVR  and  proceed  through  simulated  weapon  employments. 

Test  conditions  will  be  structured  in  a  progressive  buildup  to  examine  full  ICAAS  design 
features  and  levels  of  automation.  Initial  testing  will  utilize  an  embedded  Air  Combat 
Engagement  System  (ACES)  to  provide  onboard  computer  generated  synthetic  targets  for 
verifying  algorithms  under  controlled  conditions.  As  described  by  Lt  Brady  (7),  embedded 
scenarios  are  comparable  to  what  the  pilot  would  encounter  in  air  combat  maneuvering 
exercises.  ACES  is  also  expected  to  contribute  to  reduced  cost  of  testing  9ince  target 
aircraft  are  not  required,  more  encounters  can  be  performed  during  each  flight  and  an 
excellent  software  test  capability  resides  in  the  system.  Flight  testing  will  then 
proceed  using  onboard  sensor  measurements  of  up  to  four  aircraft  acting  as  aggressors.  A 
wingman  aircraft  will  be  lnternetted  with  the  ICAAS  testbed  for  a  limited  demonstration  of 
two  cooperative  fighters  versus  four  aggressor  aircraft. 

A  special  test  not  involving  the  ICAAS  aircraft  is  envisioned  for  validation  of  the 
missile  evasion  capability.  Missiles  obviously  cannot  be  fired  at  the  ICAAS  testbed. 
Therefore,  a  missile  will  be  launched  at  a  PQM-106  drone  over  a  test  range.  Evasion 
algorithms  hosted  in  the  ground  based  range  computers  will  determine  control  commands 
which  will  be  transmitted  to  the  drone.  This  will  provide  a  direct  demonstration  of  the 
capability  to  evade  a  threat  homing  missile  which  has  been  launched  within  "no  escape" 
parameters . 


Correlation  of  simulation  and  flight  test  results  will  receive  special  attention. 
Simulations  will  demonstrate  the  final  or  full-up  ICAAS  technology  regardless  of  whether 
the  actual  equipment  can  be  demonstrated  in  flight.  Flight  testing  will  provide  selective 
validation  of  simulation  results  using  components  which  can  be  flown  during  the  program. 
The  combined  results  of  both  types  of  testing  are  needed  to  achieve  the  best  design  trade¬ 
offs.  If  a  disciplined  system  integration  approach  has  been  followed  through  this  final 
step,  then  an  effective  ICAAS  concept  will  result. 

Summary 

The  ICAAS  program  will  achieve  significant  technology  advancements  for  fighter  aircraft  in 
the  functions  of  attack  management,  flight  management,  and  p i lot /vehi c 1 e  interface.  These 
functions  will  individually  provide  combat  performance  improvements.  Systematic 
integration  of  these  functions,  which  is  a  primary  goal  of  the  ICAAS  Program,  will  derive 
additional  performance  which  would  be  otherwise  unattainable. 
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ABSTRACT 

The  Advanced  Fighter  Technology  Integration  (AFTI1/F-16  Joint  Test  Force  recently  completed  a 
developmental  flight  test  program  investigating  a  fully  automated  weapons  delivery  system.  The  AFTI/F-16 
boasted  an  impressive  array  of  automatic  systems  that  increased  the  effectiveness  of  both  the  pilot  and 
airframe  as  an  overall  weapon  system.  The  hiqhly  modified  F- 16  testbed  was  fitted  with  a  digital  fliqht 
control  system,  a  conformally  mounted  infrared  sensor/laser  ranqinq  pod,  inteqrated  fire/fliqht  control 
computers,  a  digital  color  moving  map,  and  a  voice  recognition  system.  The  AFTI/F-16  inteqrated  these 
sensors,  avionics,  and  fliqht  control  systems  into  an  Automated  Maneuvering  and  Attack  System  (AMAS) 
capable  of  full  authority  automatic  alr-to-surface  weapons  delivery  with  profiles  down  to  200  feet  (60 
meters)  above  ground  level.  Long  range  target  detection,  lock-on,  and  tracking  was  accomplished  by  the 
forward  lookinq  infrared  radar  tracking  pod.  The  pilot  managed  the  system  by  identifying  the  target  and 
commanding  the  sensor  tracker  system  to  track.  With  AMAS  enqaged,  the  pilot  could  alter  the  auidance 
solution  or  refine  target  track  via  hands-on  controls.  During  Ingress  for  an  air-to-ground  delivery  he  was 
aided  by  a  low  altitude  radar  autopilot.  Target  position  was  updated  by  laser  range  information  and  the 
advanced  fire  control  computer.  The  only  feature  not  automated  was  airspeed  control.  Cockpit  management 
was  aided  by  a  fully  inteqrated  Voice  Interactive  Avionics  (VIA)  system  capable  of  more  than  eiahty 
functions  covering  communication,  navigation,  and  sensor  and  weapon  management.  The  VIA  had  the  ability  to 
recognize  connected  speech  and  generate  synthesized  warninqs  and  advisories.  The  effects  of  this  level  of 
cockpit  automation  were  studied  for  all  phases  of  surface  attack.  This  paper  will  present  test  results  of 
the  developmental  flight  test  proaram  and  provide  an  assessment  of  the  individual  AMAS  subsystems  on  the 
overall  workload  of  the  pilot  and  the  pilot  acceptance  of  a  fully  automated  weapons  de1-!very  system. 

ABBREVIATIONS 

AFTI  -  Advanced  Fighter  Technology  Integration 

A/G  -  Air-to-Ground 

AGL  -  Above  Ground  Lpvel 

AMAS  -  Automated  Maneuvering  Attack  System 

APPT  -  AMAS  Pre-Planned  Target 

FCC  -  Fire  Control  Computer 

FOV  -  Field  of  View 

g  -  Acceleration  Due  to  Gravity 

GCAS  -  Ground  Collision  Avoidance  System 

HUD  -  Head-up  Display 

IFFC  -  Integrated  Flight/Fire  Control 

IKP  -  Integrated  Keyboard  Panel 

MDA  -  Minimum  Descent  Altitude 

MFD  -  Multifunction  Display 

NWL  -  Non-Wings  Level 

OSB  -  Option  Select  Button 

RALT  -  Radar  Altimeter 

STS  -  Sensor  Tracker  System 

SWIM  -  System  Wide  Integrity  Management 

VIA  -  Voice  Interactive  Avionics 

VPS  -  Vertical  Planninq  Scale 

INTRODUCTION 

In  today's  high  threat  combat  arena,  the  pilot  with  the  best  available  technology  has  a  clear 
advantage.  For  alr-to-surface  weapons  employment,  a  very  low  altitude,  hiqh  speed  ingress,  coupled  with 
accurate  weapon  delivery  and  some  capability  to  standoff  from  the  tarqet  is  a  frequent  tactical  require¬ 
ment.  In  today's  combat  environment  of  numerous  weapons,  multiple  sensors,  and  extensive  counter¬ 
measures,  the  key  to  success  will  he  rapid  assessment  of  available  information  and  equally  quick  weapon 
employment.  Thus,  the  interface  of  the  pilot  with  these  advanced  technologies  is  of  paramount 
importance. 

The  AFTI/F-16  Joint  Test  Force  conducted  a  test  program  to  develop  a  fully  automated  attack  system  for 
fighter  aircraft  between  July  1984  and  April  1987.  This  proaram  was  conducted  at  Edwards  AFB,  California 
and  consisted  of  237  flights  and  more  than  347  fliqht  hours.  Testing  was  accomplished  hy  seven  pilot's 
representing  Air  Force  Systems  Command,  Tactical  Air  Command,  and  National  Aeronautics  and  Space 
Administration.  Fliqht  test  disciplines  included  flyinq  qualities,  avionics,  weapons,  and  human  factors 
evaluations. 

One  of  the  major  objectives  of  the  Automated  Maneuvering  Attack  System  (AMAS)  phase  of  the  AFTI/F-16 
flight  test  program  was  to  determine  the  level  of  pilot  acceptance,  adaptability,  and  workload  associated 
with  the  automated  low  altitude  weapons  employment.  This  determination  consisted  of  a  large  ranqe  of 
considerations,  including  a  broad-based  study  of  which  fliqht  control  modes  should  be  automated  (and  to 
what  degree),  examination  of  the  overall  contribution/distraction  of  each  avionic  subsystem,  and  detailed 
assessment  of  Individual  cockpit  displays,  controllers,  and  switches.  Oue  to  proqram  delays  and  financial 
constraints,  the  air-to-ground  automated  attack  was  the  only  capability  that  was  fully  developed; 
therefore,  that  system  alone  will  be  the  subject  addressed  in  this  paper. 
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TEST  AIRCRAFT  DESCRIPTION 

ThP  AFTI/F-16  (Figure  1)  was  a  highly  modified  pre-production  F-16  aircraft.  The  modifications 
included  an  asynchronous  triplex  digital  flight  control  system  which  provided  multiple  tas  -tailored 
flinht  control  laws  (including  decoupled  aircraft  motion).  Twin  canards  were  mounted  on  either  side 
tie^ower  portion  of  the  engine  inlet.  A  fuselage  dorsal  fairing  was  added  to  provide  internal  space  for 
avtonics  and  instrumentation  hardware.  A  forward-looking  infrared  laser  sensor  tracker  system  STS)  as 
mounted  conformally  in  the  right  wing  root  with  an  aerodynamically  similar  dummy  pod  mounted  in  the  left 
“oot  ATadar  lltimeter'lRALT, "usable  at  all  roll  attitudes  was  installed  n  the  forward  fusel  .  e 
New  and  modified  cockpit  controls  and  displays  included  a  sidestick  [[  T^Ji  ^nd  three 

with  a  twist  action  for  controlling  AMAS  functions,  a  wide  field-of-view  head-up  display  (HUD)  and 
multidisplay  kathode  ray  tubes  for  system  display  and  control.  See  Figure  2  for  cockpit  layout. 


Figure  i  AFTI/F-16  AMAS  Aircraft  Configuration 


The  baseline  avionics  hardware  and  software  for  AMAS  was  Block  75  from  the  F-1SC.  The  hardware  was 
essentially  unmodified  and  the  software  was  highly  modified  to  accomplish  AMAS  functi  ns. 


AUTOMATED  MANEUVERING  ATTACK  SYSTEM 


The  overall  goal  of  the  AMAS  Installation  was  to  maintain  the  weapon  delivery  accuracy  of  current 
bombing  systems  while  Increasing  the  survivability  of  the  delivery  platform  In  a  high  threat  environment. 
This  increased  survivability  dictated  high  speed,  low  altitude  inqress  and  eqress,  and  a  significant  "g" 
authority  for  the  system  during  maneuvering  and  weapon  delivery. 

This  tactical  capability  was  developed  in  the  AMAS  phase  of  AFTI/F-16  testlnq  through  an  automated 
bomb  delivery  system.  The  forward-looking  Infrared  sensor  and  coaxial  laser  rangefinder  were  used  for 
precise  target  location.  Target  position  was  then  Input  to  the  Integrated  fllqht/fire  control  (IFFC) 
system  to  allow  automatic  lateral  toss  bomb  deliveries.  The  complete  automated  delivery  mode  was  called 
AMAS  Pre-planned  Target  (APPT),  The  APPT  attack  could  be  separated  into  three  distinct  seqments: 
ingress,  curvilinear  weapon  delivery,  and  egress  (Figure  3). 


AMAS  BOMBING  PROFILE 


The  pilot  input  three  parameters  for  the  delivery. 
These  were  ingress  altitude  (the  altitude  above  qround 
level  at  which  the  pilot  engaged  the  system),  the 
eqress  altitude  (entered  manually  through  a  keyboard), 
and  the  desired  bomb  range  (also  a  keyboard  entry). 

The  pilot  controlled  airspeed  (with  the  throttle) 
throughout  the  delivery.  All  other  parameters  and 
inputs  were  controlled  by  the  AMAS.  The  pilot  could 
define  the  delivery  profile  through  careful  selection 
of  the  three  input  parameters  and  airspeed  control.  A 
given  airspeed/altitude  combination  corresponds  to  a 
certain  bomb  range  for  a  level  release.  If  the  pilot 
input  that  bomb  range,  the  system  delivered  the  bomb 
from  an  essentially  level  5g  turn.  If  the  pilot 
selected  a  larger  bomb  range,  the  system  would  toss  or 
loft  the  bomb;  similarly,  a  smaller  release  ranae 
resulted  in  a  divinq  delivery  as  shown  in  Figure  4. 
Real  time  adjustment  of  the  desired  bomb  range  was 
available  to  the  pilot  through  throttle  twist. 


Figure  4  APPT  Profile  Determination: 

Level/Loft/Dive 


Curvilinear  APPT  deliveries  were  successfully  conducted  from  200  feet  (60  meters)  to  2000  feet  (600 
meters)  above  ground  level  (AGL),  at  1  to  5.2g’s  load  factor,  from  7  degrees  of  dive  to  34  degrees  of  loft, 
with  up  to  115  degrees  of  bank  angle.  Airspeeds  ranqed  from  440  to  560  knots  true  airspeed. 

APPT  PILOT  ACCEPTANCE 

Pilot  acceptance  of  an  automated  maneuvering  system  with  a  5g  authority  and  200  feet  (60  meters) 
minimum  altitude  was  by  no  means  quickly  or  easily  attained.  The  following  quote  is  from  a  pilot's  report 
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of  the  eighty-first  test  mission:  “Trying  to  deliver  an  APPT  bomb... the  workload  was  so  high  on  this  flight 
that  half  the  time  it  was  impossible  and  the  other  half  of  the  time  it  was  more  work  than  I  had  done  in  any 
other  aircraft  at  any  other  time."  This  comment  was  from  an  experienced  F-16  test  pilot  after  his  eleventh 
sortie  in  the  AFTI/F-16.  Yet  only  fourteen  months  later,  another  test  pilot,  comparing  the  automated 
system  to  manual  deliveries,  made  the  following  comments  after  his  second  sortie  in  the  aircraft:  "Use 
of  the  automated  APPT  delivery  mode  greatly  reduced  pilot  workload  throughout  the  pass.  Additionally, 
(it}.. .generated  confidence  In  the  system  and  allowed  for  a  much  less  hurried  ingress  and  attack."  This 
complete  change  in  pilot  acceptance  required  significant  improvements  in  three  areas:  pilot  confidence 
in  the  system,  aircraft  flying  qualities  during  APPT,  and  pilot  interface  with  the  system  (particularly 
improvements  in  STS  operation). 

SYSTEM  WIDE  INTEGRITY  MANAGEMENT 

Pilot  confidence  in  the  AMAS  was  achieved  through  the  development  and  test  of  an  independent  AMAS 
monitor  called  System  Wide  Integrity  Management  (SWIM).  This  not  only  provided  artificial  redundancy  to 
the  single  strand  avionics  systems  (such  as  the  radar  altimeter)  but  functioned  as  a  ground  collision 
avoidance  system  (GCAS)  as  well.  Successful  operation  of  both  of  these  functions  was  necessary  for  the 
safe  operation  of  the  automated  attack  system  at  low  altitude  and  high  airspeed. 

SWIM  continually  monitored  the  aircraft's  flight  path  with  respect  to  a  pilot  selected  minimum  ground 
clearance  plane  called  the  minimum  descent  altitude  (MDA).  If  the  system  predicted  that  the  MDA  would  be 
penetrated,  it  would  first  warn  the  pilot  and  then,  if  penetration  was  still  imminent,  fly  the  aircraft  up. 
Pilot  warning  consisted  of  a  verbal  “pull  u,  ,  pull  up"  and  chevrons  appearing  in  the  HUD  five  seconds 
prior  to  flyup  (Figure  5).  As  time  to  flyu  decreased,  the  chevrons  moved  together.  At  flyup,  the 
chevrons  touched  (forming  a  traditional  "br^ak  X");  the  pilot  heard  a  tone  and  "fly  up,  fly  up";  the 
aircraft  automatically  rolled  to  wings  level  and  pulled  5g's  untfl  a  3  degree  climb  angle  was  achieved. 


Figure  5  HUD  Presentation  for  Flyup 

The  SWIM  system  would  continually  monitor  avionic  and  flight  control  systems  to  ensure  proper 
operation.  If  any  of  the  systems  were  not  fully  functional,  SWIM  would  prevent  engagement  of  AMAS.  If 
AMAS  were  already  engaged,  ft  would  disengage  the  system  and  tell  the  pilot  "you  got  it."  If  the  failure 
occurred  when  the  aircraft  was  within  500  feet  (150  meters)  of  the  MDA  or  within  5  seconds  of  flyup,  SWIM 
would  accomplish  a  flyup  prior  to  system  disengagement. 

SWIM  was  successfully  tested  throughout  the  air-to-ground  envelope.  Load  factors  of  -I  to  +6q's, 
maximum  roll  rates,  and  airspeeds  up  to  550  knots  were  tested;  15  degrees  of  dive  and  135  deqrees  of  bank 
were  tested  to  150  feet  (as  me>+ars)  aGL;  higher  dive  and  bank  angles  to  500  feet  (150  meters).  Successful 
completion  of  this  testing  was  a  large  asset  in  building  pilot  confidence  in  safety  of  AMAS.  Additionally, 
a  SWIM  validation  was  the  first  maneuver  flown  on  any  weapon  delivery  sortie,  further  increasing  pilot 
confidence. 

SWIM  operated  flawlessly  throughout  the  flight  test  program.  The  only  deficiency  in  the  SWIM  system 
was  its  use  of  only  radar  altimeter  data  for  terrain  clearance,  with  no  forward  looking  capability.  It 
was  designed  for  level  terrain  use  only  (two  percent  terrain  slope).  Durlnq  flight  near  the  MDA,  this 
tended  to  produce  nuisance  flyups  when  even  small  obstacles  were  overflown. 

APPT  FLYING  QUALITIES 

The  AMAS  had  full  authority  for  roll  rates  of  180  degrees/second,  all  hank  angles,  and  -1  to  5q's  in 
pitch.  Additionally,  up  to  la  of  direct  si  deforce  could  be  generated  throuqh  simultaneous  deflection  of 
the  canards  and  rudder  in  a  mode  called  "flat  turn."  This  was  the  only  air-to-ground  decoupled  motion 
used  for  AMAS.  Altitude  control  was  achieved  through  a  low  altitude  radar  autopilot,  which  would  hold 
selected  radar  altitude  by  the  use  of  bank  anqle/load  factor.  Pilot  blendinq  was  allowed  with  AMAS 
engaged  (i.e.,  pilot  stick  inputs  above  a  certain  threshold  would  be  summed  with  automated  commands). 

The  AMAS  used  this  control  authority  in  each  of  the  three  segments  of  the  APPT  attack.  Ourinq  inqress, 
the  system  flew  the  aircraft  at  the  engagement  altitude  to  a  pofnt  offset  from  the  target.  This  point  lay 
on  a  sphere  around  the  tarqet  defined  by  a  5q  turn  radius  and  the  desired  bomb  release  ranne  (i.o.,  the 
aircraft  would  fly  to  a  point  where  a  5g  turn  would  be  required  to  achieve  bomb  release  at  the  desired 
range).  System  engagement  too  close  to  this  imaginary  sphere  would  result  In  a  check  turn  away  from  the 
target  before  resuming  the  attack;  engagement  inside  the  sphere  would  result  In  the  aircraft  flying  away 


from  the  target  and  an  automatic  reattack.  During  the  attack  segment  of  the  delivery,  the  aircraft  would 
turn  (nominally  at  5g‘s)  to  align  the  bomb’s  velocity  vector  with  the  target  at  the  selected  release  ranqe. 
One  half  second  after  bomb  release,  the  aircraft  would  enter  the  earess  seqment.  The  aircraft  would  roll 
to  135  degrees  of  bank  and  pull  up  to  5g’s  in  slicing  down  to  acquire  the  pre-selected  egress  altitude.  It 
would  then  execute  a  5q  level  turn  at  egress  altitude  until  disenqaged. 

Pilot  complaints  while  flight  testing  early  ingress  mechanizations  were  frequent.  Problems  with  the 
pitch  axis  (normal  load  factor)  centered  on  the  ability  of  the  autopilot  to  hold  altitude,  particularly 
during  turns.  Ingress  steering  used  a  maximum  bank  angle  of  75  degrees;  altitude  control  (even  over 
rolling  terrain)  was  achieved  not  by  changing  bank  angle,  but  by  varying  normal  load  factor.  This 
resulted  in  an  aircraft  motion  variously  described  as  bucking  or  heaving  (the  latter  a  particularly 
appropriate  term).  Load  factor  would  vary  by  as  much  as  +lg.  Roll  onset  rates  caused  many  complaints; 
roll  into  a  bank  seemed  abrupt,  while  the  rollout  on  attack  heading  was  very  gradual.  Additionally,  the 
last  few  degrees  of  heading  change  (for  ingress  steering  to  the  offset  point)  were  achieved  with  flat 
turn  as  the  wings  were  levelled.  Flat  turn  (direct  side  force)  was  also  used  for  small  but  seeminoly 
instantaneous  heading  changes  during  target  update.  This  apparently  unpredictable  use  of  side  force  was 
generally  disliked  by  the  pilots.  Numerous  different  control  mechanizations  for  the  use  of  flat  turn  were 
tried,  including  changing  control  authority  and  when  flat  turn  was  implemented.  No  acceptable  amount  of 
flat  turn  was  ever  determined  and  pilot  opinion  finally  prevailed.  Starting  with  the  175th  test  flight, 
flat  turn  was  made  a  pilot  selectable  option.  Without  exception,  pilots  then  chose  the  control  mode  that 
did  not  use  flat  turn.  This,  however,  was  a  mixed  blessing;  during  ingress  this  mode  frequently  resulted 
in  flight  in  a  continuous  small  bank  (whereas  the  flat  turn  mode  was  able  to  maintain  wings  level  even  for 
crosswind  corrections). 

The  biggest  flying  qualities  problem  encountered  with  the  attack  segment  itself  was  the  transition 
from  ingress  to  curvilinear  or  non  wings  level  (NWl)  steering.  This  transition  was  generally  remarked 
upon  as  being  "abrupt,”  although  this  improved  somewhat  as  the  program  progressed.  The  most  startling 
problem  occurred,  however,  if  the  IFFC  system  perceived  a  discrete  jump  in  aircraft  state  near  the 
imaginary  sphere  delineating  the  ingress  segment  from  the  attack  segment  (e.g.,  a  large  target  range 
magnitude  jump  near  this  border).  The  aircraft  might,  after  having  smoothly  transitioned  to  the  5a  NWL 
steering,  decide  it  was  really  not  yet  to  the  sphere  and  transition  back  to  a  lg  ingress  condition 
(followed  shortly  thereafter  by  another  transition  to  5g  NWL  steering).  Heedless  to  say,  this  certainly 
caught  the  pilot's  attention  at  very  low  altitude.  This  problem  was  alleviated  to  some  extent  by 
increasing  the  reliability  of  the  range  inputs  to  the  fire  control  computer.  Additionally,  adding  some 
hysteresis  to  the  range  at  which  the  aircraft  transitioned  to  NWL  steerina  smoothed  this  considerably. 

Prior  to  this  change,  as  many  as  three  mode  changes  in  less  than  one  second  were  occassional ly  seen  durinq 
the  transition  (at  which  time  SWIM  disengaged  AMAS). 

The  most  frequent  source  of  pilot  interface  problems  during  the  delivery  phase  of  APPT  involved  the 
mechanization  of  pilot  blending.  As  mentioned  earlier,  pilot  stick  input  (above  a  certain  threshold 
level)  would  be  summed  with  the  .automated  flight  control  commands.  It  was  the  level  of  this  threshold 
(breakout),  that  caused  the  most  problems.  Frequently  during  bomb  delivery,  the  pilot  would  unknowingly 
input  a  significant  amount  of  left  roll  stick  (up  to  ten  pounds  (4.5  kilograms),  certainly  above  the  six 
pound  (2.7  kilograms)  breakout).  These  inadvertent  pilot  inputs  would  "corrupt"  the  APPT  delivery, 
causing  roll  angle  errors  at  bomb  release:  indeed,  pilot  inputs  right  at  the  breakout  level  would  result 
in  neither  the  pilot  nor  the  flight  control  computers  controlling  roll.  The  cause  of  this  inadvertent 
pilot-induced  roll  error  was  twofold.  First,  it  was  a  human  factors  problem.  The  release  consent 
(pickle)  button  was  offset  to  the  left  of  center  on  the  control  stick  -  holding  the  button  down  with  the 
thumb  during  the  delivery  resulted  in  a  left  roll  input.  Second,  it  appeared  to  be  a  result  of  pilot 
apprehension  during  the  low  altitude  attack  maneuvering.  This  was  indicated  by  the  fact  that  little  pilot 
induced  roll  error  was  experienced  in  the  simulator,  and  during  flight  test,  the  severity  of  the  problem 
increased  as  altitude  decreased.  It  is  noteworthy  that  a  left  stick  input  commanded  a  climb  during  our 
attacks  (all  deliveries  were  accomplished  in  right  turns  due  to  STS  location  in  the  right  wing). 

Pilots  had  three  major  complaints  with  the  eqress  segment  of  the  APPT  manuever.  The  first  was  a  sort 
of  dichotomy  in  that  although  the  egress  maneuver  itself  was  not  as  aggressive  as  most  pilots  would  have 
flown  it  "hands  on,"  the  5g,  135  deqree  slice  back  to  the  eqress  altitude  was  certainly  violent  enough  to 
be  uncomfortable  (again,  the  roll-in  seemed  particularly  abrupt).  It  the"  seemed  to  ease  off  too  soon 
approaching  the  egress  altitude,  resulting  in  a  qraoual  descent  durinq  the  last  few  feet.  This  was  not 
aggressive  enough  for  combat  maneuvering.  The  second  complaint  was  more  significant.  On  numerous 
occasions,  the  eqress  maneuver  would  pull  down  towards  the  qround  hard  enough  to  result  in  a  flyup.  While 
this  was  not  a  particularly  frequent  occurrence,  pilots  were  not  willing  to  accept  an  automated  system 
that  would  satisfactorily  perform  a  low  altitude  ingress  and  weapon  delivery  in  a  simulated  hi  ah  threat 
environment  only  to  subsequently  fly  them  up  and  expose  them  during  egress.  Finally,  the  endpoint  of  the 
egress  maneuver  (a  5g  level  turn  upon  reaching  the  eqress  altitude),  while  acceptable  for  flinh*  test,  was 
inappropriate  for  combat.  Pilots  aareed  that,  egress  to  a  preselected  heading  or  steerpoint  would  be 
preferable. 

SENSOR  TRACKER  PERFORMANCE 

The  final  stumblinq  block  to  acceptable  automated  low  altitude  attack  concerned  the  level  of  pilot 
workload  during  the  delivery  profile.  Most  workload  was  associated  with  the  use  of  the  infrared  sensor 
tracker/laser  ranqe  finder.  Thus,  successful  integration  of  the  STS  into  the  system  hecame  a  major 
concern.  Weapon  delivery  on  Inertial  tarqet  coordinates  did  not  satisfy  accuracy  requirements;  precise 
target  state  information  was  required  for  the  fire  control  computer.  This  meant  *that  the  STS  had  to  he 
able  to  support  low  altitude  operation  with  the  capability  to  acquire,  lockon,  track,  and  lase  a  tarqet 
from  far  enough  out  to  enable  automated  maneuvering  to  weapon  release  ranges  of  up  to  20,000  feet. 

Tarqet  acquisition  was  the  first  problem  solved,  but  always  required  considerable  pilot  familiarity 
with  the  target  area  to  ensure  proper  tarqet  identification.  Early  In  the  program  the  STS  would  present 
target  video  to  the  pilot  at  sufficient  range  to  support  bombing  objectives.  Suitable  lockon  and  track 
capability,  however,  came  much  later.  Pilots  found  it  very  frustrating  to  be  able  to  locate  the  tarqet  in 


the  STS  video,  but  not  be  able  to  achieve  lockon.  When  lockon  finally  was  achieved,  it.  was  freauently 
lost  soon  thereafter,  a  further  source  of  pilot  frustration.  Lockon/track  ability  was  enhanced  by 
eliminating  noise  in  the  video,  improving  tracker  gimbal  stability,  and  improvinn  trackinq  logic  schemes. 
Providing  better  cue  range  and  target  height  data  to  the  STS  enabled  better  qround  stabilization  of  the 
video  scene  by  reducing  apparent  target  drift  rates;  this  facilitated  lockon  by  the  pilot  and  enabled  a 
quick  relock  if  STS  track  were  lost.  These  improvements  allowed  consistent  STS  track  capability  early 
enough  in  the  run  to  enable  use  of  the  laser  for  taraet  ranqe  update.  This  reduced  time  compression  and 
workload  for  the  pilot;  it  allowed  him  time  to  monitor  aircraft  altitude  and  airspeed,  system  performance, 
weapon  system  status,  planned  delivery  profile,  etc.,  increasing  pilot  situational  awareness  during  the 
delivery.  This  breakthrouqh,  occurring  in  late  November  of  19R6,  was  a  major  change  from  earlier  episodes 
of  head-down  operation  wherein  the  pilot  continually  attempted  STS  lock  and  relock  all  the  way  throuqh 
release.  It  significantly  changed  pilot  perception  of  AMAS  ease  of  operation,  capability,  and 
applicability. 

These  improvements  in  flying  Qualities  during  AMAS  maneuvering,  coupled  with  STS  performance  that 
supported  accurate  APPT  weapon  delivery  with  a  tolerable  oilot  workload,  backed  with  pilot  confidence 
through  SWIM,  finally  allowed  the  AMAS  to  achieve  the  payoff  originally  hypothesized  for  the  automated 
system:  improved  weapon  delivery  capability  for  a  high  threat  environment. 

PILOT  VEHICLE  INTERFACE 

In  addition  to  the  areas  already  discussed,  pilot  acceptance  of  the  AMAS  was  closely  tied  to  the  oilot 
interface  with  the  system.  In  this  regard,  the  following  areas  will  be  discussed:  cockpit  controls  (the 
stick,  throttle,  and  multifunction  displays),  the  cockpit  displays  (HUD,  STS  display,  diqital  map)  and  one 
additional  interface,  voice  interactive  avionics. 

HANDS-ON  STICK  AND  THROTTLE 

The  AFTI/F-16  cockpit  was  designed  for  "hands-on"  operation  to  the  maximum  extent  possible.  To  this 
end,  ten  switches  were  located  on  the  sidestick  controller  and  eiaht  more  on  the  throttle.  To  increase 
the  power  of  this  arrangement,  several  of  the  switches  had  multiple  functions,  dependina  upon  flight  phase 
or  maneuver  (see  Figure  6). 
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Figure  6  AFTI/F-16  Throttle  and  Stick 


AMAS  functions  controlled  on  the  stick  included  manual  engagement/disengagement  of  the  independent 
fliqht  control  backup  mode,  cockpit  display  management,  enqagidg/disenqaqinq  IFFC,  alternate  mode 
selection  (alternate  flight  control  mode,  execution  of  a  less  than  5g  curvilinear  delivery,  execution  of 
an  alternate  lg  wings  level  profile,  reversion  to  curvilinear  attack  from  wings  level  attack],  laser 
consent,  manual  STS  field  of  view  changes,  STS  lock/break  lock  command,  weapon  release  consent,  and 
finally,  flight  path  control  through  pilot  blending.  AMAS  functions  on  the  linear  throttle  included 
cursor  control  of  STS  aimlnQ,  release  range  adjustment  through  throttle  twist,  and  airspeed  control. 

Needless  to  say,  switch  errors  with  the  above  arrangement  with  were  not  uncommon  occurrences  during 
the  course  of  the  flight  test  program--regardless  of  pilot  experience.  These  errors  ranged  from  merely 
embarrassing  (transmitting  on  the  wrong  radio],  to  the  annoying  (enterinq  a  rotary  requiring  numerous 
switch  actions  for  recovery),  to  serious  (hitting  the  wrong  paddle  switch,  thus  inadvertently  disengaging 
the  system  and  abortinq  a  test  run),  tj  potentially  catastrophic  (engaging  the  throttle  cut-off  instead  of 
the  twist  grip  release).  The  AFTI/F-16  certainly  explored  the  limit  of  usable  hardware  on  the  stick  and 
throttle. 

The  engagement/di senqagement  of  the  system  through  the  lower  paddle  switch  was  straight-forward.  The 
four  different  alternate  mode  selection  functions  of  the  upper  paddle  switch  (which  did  not  remain  the 
same  throughout  the  test  program)  were  confusing  and  prone  to  pilot  errors.  Hands-on  control  of  the 
sensor  tracker  evoked  much  pilot  comment.  STS  field  of  view  change  capability  on  the  stick  was 
convenient,  but  the  rotary  involved  (narrow-medium-wide-medium-narrow)  was  unwieldy.  If  the  pilot  was 
unsuccessful  in  locating  the  tarqet  in  the  narrow  FOV,  use  of  medium  FOV  then  required  four  more  switch 
actions  to  return  to  narrow  FOV  for  lockon.  STS  aiminq  through  the  cursor  control  switch  on  the  throttle 
was  a  continual  problem.  Maximum  STS  cursor  input  never  had  enough  authority  to  rapidly  slew  the  STS 
field  of  view  to  the  target  (or,  until  the  tarqet  drift  problem  was  solved,  to  keep  the  tarqet  in  the  FOV 
even  if  it  were  acquired);  use  of  alternate  cursor  mechanizations  for  other  slew  rates  through  the  HUD  or 
radar  cursor  controllers  proved  unworkable  since  they  corrupted  tarqet  height  or  other  data.  Once  the 
target  was  In  the  STS  video,  even  the  smallest  possible  cursor  input  seemed  too  large.  This,  coupled  with 
a  somewhat  uncertain  orientation  of  the  axes  of  the  cursor  button  due  to  its  location  on  the  side  of  the 
throttle,  frequently  resulted  in  "spiraling  in"  cursor  inputs  or  pilot  induced  cursor  oscillations  until 
STS  target  lockon. 

OTHER  PILOT  CONTROLS 

Pilot  Inputs  through  the  twenty  option  select  buttons  (OSBs)  around  each  of  the  three  multifunction 
displays  (MFDs)  and  through  the  Integrated  keyboard  panel  (IKP)  were  generally  perceived  as  being 
straightforward.  The  reduction  in  the  overall  number  of  switches  by  havlnq  the  OSBs  perform  different 
functions  (depending  upon  MFD  format)  was  particularly  appreciated.  The  MFDs  were  easily  accessed  with 
either  hand;  the  IKP  however,  was  located  under  the  left  canopy  rail  and  obscured  by  the  landinq  qear 
handle,  makinq  it  inconvenient  for  inflight  use. 

The  laser  arm  switch  was  located  on  the  left  armament  panel  above  the  master  arm  switch.  While  this 
was  a  convenient  location,  the  switch  was  unfortunately  similar  in  size  and  shape  to  the  nearby  master  arm 
switch,  causing  confusion  and  switch  errors.  Additionally,  the  lever  lock  switch  had  two  "arm"  positions: 
down  for  manual  arm  l requiring  pilot  consent  on  the  sidestlck  triqger  for  lasina)  and  up  to  auto  for 
continuous  lasing  with  STS  lockon  (a  position  never  intentionally  used  due  to  the  unrel iabi 1 i ty  of  STS 
lock).  In  attempting  to  safe  the  laser  during  the  automated  5g  egress  maneuver,  it  was  quite  easy  to  qo 
from  manual  arm  through  safe  to  auto,  with  the  effect  (continuous  lasing)  being  quite  the  opposite  from 
that  Intended.  This  was  a  major  safety  deficiency  in  the  AFTI  cockpit  design. 

HEAD-UP  DISPLAY 

Visual  display  of  flight  information  was  presented  in  a  wide  field-of-view  HUD  in  the  form  of 
stroke-wri tten  symbols  focused  at  infinity.  The  symbols  represented  information  relatinq  to  navigation, 
attack,  weapon  aiminq,  and  landinq,  includina  essential  aircraft  performance  data  (Figure  7). 


The  AFTI  HIJD  was  equipped  with  diqital  readouts  for  airspeed,  altitude,  and  heading,  and  increment 
marks  for  analog  display  of  the  same.  The  diqital  readouts  were  for  instantaneous  interpretation  of 


airspc.d,  altitude,  and  heading.  The  analog  scales  were  presented  for  trend  information  durinq  rapid 
changes  in  parameters.  Airspeed  was  scaled  in  25  knot  increments  and  altitude  was  scaled  in  250  feet 
(76  meters)  increments.  Pilots  had  difficulty  in  rapidly  interpretina  the  scale  increments  and  would  have 
preferred  smaller  Increments  (10  knots  and  100  feet  (30  meters))  on  the  analog  scales.  The  thermometer 
presentation  of  radar  altitude  was  very  useful  in  the  low  altitude  environment.  The  analog  presentations 
of  the  autopilot  reference  altitude  and  the  MDA  were  convenient.  This  display  would  have  been  more  useful 
if  the  radar  altitude  display  would  have  been  nonlinear  (i.e.,  large  scale  increments  at  hiqher  altitudes 
and  smaller  increments  for  precise  altitude  control  at  very  low  altitude). 


One  of  the  cockpit  displays  used  durinq  an  AMAS  air-to-ground  delivery  mode  was  the  vertical  p'anning 
scale  (VPS)  shown  in  Figure  8.  The  VPS  was  displayed  in  the  HUD  and  provided  the  pilot  with  his  predicted 
APPT  delivery  profile  (climbing,  descending,  or  level),  anticipated  release  altitude,  and  maximum  or 
minimum  altitude.  Pilots  agreed  with  the  VPS  concept  but  did  not  like  ics  mechanization.  Some  of  the 
problems  noted  were:  the  VPS  did  not  appear  until  late  In  the  ingress  maneuver  {which  left  little  time  to 
adjust  the  delivery  profile  through  pilot  blending  or  release  range  changes);  the  VPS  did  not  smoothly 
transition  from  lofting  to  diving  deliveries  durinr,  pilot  blending  or  release  range  changes;  the  digital 
data  was  not  found  in  the  same  location  for  different  delivery  profiles;  and  the  display  presentation  was 
not  easily  interpreted. 
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MULTIFUNCTION  DISPLAYS 


In  addition  to  the  HUD,  primary  cockpit  displays  consisted  of  two  monochromatic  four  inch  (1.6 
centimeter)  cathode  ray  tubes  and  a  five  Inch  (2.0  centimeter)  color  tube  called  multifunction  displays 
(due  to  the  variety  of  formats  available).  Display  capabilities  ranoed  from  built-in  test,  to  flight 
control  functions,  to  stores  management,  to  sensor  information  (radar  and  STS).  The  cockpit  setup  of 
display  format  (primary  and  backup  for  each  MFD)  was  pilot  selectable  for  each  flight  mode;  although  time 
consuming  durinq  preflight  procedures,  it  certainly  was  an  asset  during  flight  to  have  the  cockpit 
customized  to  the  pilot's  personal  preferences. 


The  MFD  format  of  primary  importance  during  an  APPT 
weapon  delivery  was  the  sensor  tracker  page.  In 
addition  to  target  video,  this  display  presented  tarqet 
range,  laser  and  weapon  status,  and  an  artificial 
horizon  (Figure  9).  Early  testing  showed  that  pilots 
were  much  more  comfortable  with  a  %ky  up"  presentation 
of  the  target,  as  opposed  to  presenting  it  with  respect 
to  aircraft  body  axis  coordinates.  Major  pilot 
complaints  with  STS  mechanization  concerned  cursor 
control  and  FOV  changes,  as  already  discussed.  Other 
complaints  concerned  poor  video  quality  (requiring 
extensive  pilot  i nterpretatlon  of  the  scene  and 
background  to  confirm  proper  target  identification)  and 
the  lack  of  any  definitive  means  (such  as  a  gray  scale) 
to  adjust  video  level  and  sensor  gain  prior  to  enterinq 
the  target  area.  These  deficiencies  decreased 
probability  of  a  successful  "first  pass"  APPT  delivery. 


Figure  9  Sensor  Tracker  Page 


The  center  MFD  was  a  five  inch  (2.0  centimeter)  color  tube  that  could  present  a  moving  map,  flight 
instrument  displays,  or  flight  control  Information.  Unfortunately  for  the  evaluation,  the  brightness  and 
contrast  of  the  center  MFD  were  insufficient  to  support  inflight  use.  This  prevented  comprehensi ve  fliqnt 
evaluation  of  the  digital  map  and  terrain  data  base  incorporated  into  the  system. 

VOICE  INTERACTIVE  AVIONICS 

The  one  pilot/vehicle  interface  that  generated  much  interest  was  the  use  of  voice  interactive  avionics 
(VIA).  Certainly,  in  a  single  seat  cockpit  that  had  already  approached  the  utility  limits  of  displays  and 
switches,  an  aircraft  that  could  talk  to  the  pilot  and,  more  importantly,  respond  to  verbal  commands, 
seemed  to  be  the  ultimate  answer.  The  voice  interface  between  pilot  and  aircraft  could  be  divided  into  two 
parts:  synthesis  and  recogni tion/response. 

Voicp  synthesis  was  provided  for  warnina  and  caution  annunciation;  advisories  for  preset  altitudes  or 
fuel  states  were  also  available.  Operation  of  these  features  was  satisfactory.  VIA  response  to  pilot 


voice  inputs  was  also  synthesized,  providing  feedback  to  the  pilot  for  VIA  activations. 

Pilots  could  control  communication,  navigation,  cockpit  displays,  weapon  selection,  sensor  management, 
and  check  on  aircraft  parameters  through  the  voice  system.  Three  different  VIA  alaorithms  were  tested. 

The  first  algorithm  tested  used  a  linear  predictive  coding  scheme  that  used  pattern  matched  words  within  a 
particular  qrammar.  Once  a  match  was  made,  the  node  within  the  grammar  was  switched  to  provide  recognition 
of  only  valid  phrases.  Figure  10  presents  a  typical  nodal  structure  used.  This  algorithm  provided  a 
connected  speech  capability.  Testing  of  this  algorithm  was  terminated  early  in  the  proqram  due  to  software 
and  hardware  integration  problems.  The  second  algorithm  was  designed  for  isolated  word  recognition.  It 
also  used  a  nodal  structure  to  increase  recognition  accuracy  and  decrease  response  time.  It  provided  an 
audio  "beep"  as  feedback  to  the  pilot  for  successful  word  recognition.  The  majority  of  flight  test  results 
presented  apply  to  this  algorithm.  The  final  algorithm  used  connected  speech  loaic,  looking  at  the  entire 
phrase  spoken  for  recognition.  Extremely  limited  flight  test  of  this  algorithm  was  conducted  due  to  its 
introduction  at  the  end  of  the  flight  test  program. 


Figure  10  AFTI/r-ie  Voice  Nodal  Structure 

'ise  of  the  VIA  system  required  extensive  preparation  and  ♦•raining,  primarily  to  create  a  robust  set  nt 
voice  templates  for  individual  pilot  use.  Templates  were  the  data  base  the  VIA  system  used  for  voice 
recognition.  Template  creation  required  initial  enrollment  of  each  of  the  1??  words  of  thp  VIA  vocabulary, 
then  "training"  of  thp  template,  periodic  update  of  the  template,  and  template  verification  in  thp  aircraft 
prior  to  flight.  Although  the  VIA  vocabulary  was  carefully  selected  to  correspond  as  closely  as  possible 
to  familiar  pilot  terminology,  use  of  the  VIA  was  not  completely  natural  due  to  the  nodal  structure  and 
syntax.  Pilots  aqreed  it  was  somewhat  like  learninn  a  small  foreign  language. 

Flight  tMSt  o*  the  systems  progressed  from  hpnign  flight  conditions  { I  g  level  flightl  to  more  demanding 
conditions  (elevated  load  factor  or  high  rockm't  noise)  to  mission  ♦asks  'inflight  refueling,  air-tn-a’r 
tracking,  low  level  navigation  and  ground  attack),  "he  flight  tpst  results  for  three  pilots  fh,at 
e x tens i ve 1 y  used  the  system  are  presented  in  Figure  11. 

p  i  1 OT  perception  of  recognition  rafes  was  worse  than  thp  test  star,  i  s*i  show,  Ppcognitioe  rate« 
presented  rightfully  show  }nly  errors  t*r  -to  srecnqn  i  t  i  OP  hv  the  VIA  system  m*’  discount  "pilot  errors"  Me 
to  improper  utteranres  f being  in  the  wrong  grammar  node,  *,or  example).  The  piV.t,  however,  perceive’’  that 
he  had  used  voice  to  request  some  action  by  the  aircraft  that  was  no*  honored  -  a  VIA  deficiency. 
Additionally,  recoqniton  rates  were  degraded  by  up  to  V'  percent,  for  other  than  benign  Ig  flight  .  .  ,n  ti  t  i  or 
^elevated  g,  nigh  cockpit  noise,  etc.). 

Overall  pilot  acceptance  *)f  the  system  was  directly  rotated  h  VIA  recognition  \  <.(r^v,  AM  r'l^*s 
reali/ed  a  "learning  curve"  where  recognition  jn  -reased  and  f..-n  stabilized  a  final  h’ho  '  asr.j*  » 
percent).  Pilot*  g,.nerallv  disliked  the  ertengiye  prefMght  preoara  ♦  i  on  required  to  ijs.-  fhp  yn’T  r  ^  .  *n 

f  enrol  Iment ,  training,  update,  and  yen  f  irat  ipe).  •  or  the  pi’gt  with  the  h«s*  reroqni ♦ inn  ••»tp  1 
percent)  acceptance  <  a  me  wholehearted1  y  and  he  wouM  readily  use  the  Svs*en  f  C  ro.jtiie  V 

even  when  not  required  by  fest  objectives.  Mir  pilots  *i»h  si  goi  t  i  ■  a^t  ’  y  1  --wo.-  r(»,-  .gni  t  inn  .ates,  .,*e  p* 
the  /  IA  came  .inly  reluctantly  fnr  f  e-r  gf  mi  gre,  ggn  i  t  i  on  ,M*  suh  s  t  i  t  SJ  *  •  n  _ 
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Certainly  the  voice  activation  of  aircraft  functions  will  require  hiqher  recognition  rates  and  more 
robust  recognition  templates  for  general  pilot  acceptance. 


O  PILOT  1  - 

4515  EVENTS  ELEV  G: 

4-7  g'S 

mil  PILOT2 

1262  EVENTS  NOISY: 

PRESSURE 

1H  PILOT3  - 

1901  EVENTS 

BREATHING. 
FULL  COCKPIT 

Figure  J1 

VIA  Fli'qht  Test  Results 

DEFOG.  ETC. 

SUMMARY 

Pilot  acceptance  of  an  automated  maneuvering  surface  attack  system  was  achieved  during  the  AFT1/F-16 
AMAS  flight  test  program.  Automated  attack  with  the  final  system  configuration  was  preferred  to  manually 
flyino  the  deliveries.  Pilot  confidence  in  the  system  was  gained  through  system  wide  integrity  management 
and  its  associated  qround  collision  avoidance  system.  Improvements  in  aircraft  flyino  qualities  durinq 
automated  maneu  ring,  and  improved  capability  and  interface  of  the  infrared  sensor  tracker,  ultimately 
allowed  the  pilot  to  satisfactorily  accomplish  coupled  deliveries  as  low  as  200  feet  (60  meters)  AGL. 

Problems  were  identified  with  the  pilo./vehicle  interface  of  the  system.  The  limit  of  usable  hardware 
on  the  stick  and  throttle  was  reached.  Deficiencies  in  the  presentation  of  the  curvilinear  profile  and 
parameters  in  the  HUD  were  identified.  Use  of  voice  activation  for  aircraft  and  avionic  functions  was 
found  to  require  better  recognition  rates  for  general  pilot  acceptance. 

Overall,  the  AFTI/F-16  automated  maneuvering  attack  system  was  found  to  provide  an  increase  in  aircraft 
weapon  delivery  capabi 1 i ties- 
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ADVANCED  HELICOPTER  COCKPIT  AND  CONTROL  CONFIGURATIONS 
FOR  HELICOPTER  COMBAT  MISSION  TASKS 

Loran  A.  Haworth,  Adolph  Atenclo.  Jr.,  Courtland  Bivens, 

Robert  Shively,  and  Oanlel  Delgado 

U.S.  Army  Aerof Hghtdynamlcs  Directorate,  Moffett  Field,  California  94035,  U.S.A 


SUMMARY 

Two  piloted  simulations  were  conducted  by  the  U.S.  Army  Aerof 1 Ightdynamics  Directorate  to  evaluate 
workload  and  helicopter-handling  qualities  requirements  for  single  pilot  operation  in  a  combat  Nap-of-the- 
Earth  environment.  The  single-pilot  advanced  cockpit  engineering  simulation  (SPACES)  investigations  were 
performed  on  the  NASA  Ames  Vertical  Motion  Simulator,  using  the  Advanced  Digital  Optical  Control  System 
control  laws  and  an  advanced  concepts  glass  cockpit.  The  first  simulation  (SPACES  I)  compared  single  pilot 
to  dual  crewmember  operation  for  the  same  flight  tasks  to  determine  differences  between  dual  and  single 
ratings,  and  to  discover  which  control  laws  enabled  adequate  single-pilot  helicopter  operation.  The 
SPACES  II  simulation  concentrated  on  single-pilot  operations  and  use  of  control  laws  thought  to  be  viable 
candidates  for  single  pilot  operations  workload.  Measures  detected  significant  differences  between  dual- 
and  single-pilot  operation  and  between  slngTe-pilot  task  segments.  Control  system  configurations  were 
task  dependent,  demonstrating  the  need  for  an  inflight  reconf igurable  control  system  to  match  the  optimal 
control  system  with  the  required  task. 

GLOSSARY 

AOOCS  advanced  digital  optical  control  system 

AGL  above  ground  level 

ART  I  advanced  rotorcraft  technology  integration 

ARMCOP  Army  copter 

ASE  aircraft  survivability  equipment 

AT /AT  attitude  command /attitude  stabilization  (hold) 

AT/VH  attitude  command /velocity  hold 

CGI  computer  generated  imagery 

CRT  cathode  ray  tube 

CSRDP  crew  station  research  and  development  program 

E&S  Evans  and  Sutherland 

FPM  fllghtpath  management 

HAC  helicopter  air  combat 

HQR  handling  quality  rating 

HUD  head-up-dlsplay 

K I AS  knots  Indicated  air  speed 

LHX  light  helicopter  family 

MM  mission  management 

MMO  mission  management  display 

NASA  National  Aeronautics  and  Space  Administrat ion 

NOE  nap-of -the-Earth 

OGE  out  of  ground  effect 

RT/AT  rate  command/attitude  stabilization  (hold) 


SPACES 

single  pilot  advanced  cockpit 

engineering  simulation 

SWAT 

subjective  workload  analysis 

technique 

TSO 

tactical  situation  display 

CJH-60 

U.S.  Army  Utility  Helicopter 

-  60  (Slackhawk) 

VMS 

Vertical  Motion  Simulator 

1.  INTRODUCTION 

The  missions,  tactics,  and  crew-task  demands  of  the  Army  helicopter  operations  have  undergone  rapid 
and  extensive  change.  One  such  change  is  the  emphasis  to  fly  only  a  few  feet  above  the  terrain  and  as 
close  as  possible  to  obstacles  for  maximum  protection  from  perceived  air  defense  threats.  Given  past 
technology,  both  pilot  and  co-pilot  workload  is  high  during  NOE  flight.  For  one  pilot  to  perform  both 
flightpath  management  and  mission  management,  both  tasks  will  have  to  be  simplified  or  automated  to 
achieve  adequate  performance. 

The  overall  problem  is  to  define  aircraft  stability,  control,  and  performance  characteristics,  that 
when  combined  with  the  appropriate  cockpit  devices  (e.g.  integrated  CRTs,  helmet -mounted  displays,  touch- 
pads,  voice  input/output,  moving  map  displays),  allow  adequate  mission  and  flight  performance.  Several 
efforts  have  been  underway  to  address  these  broad  advanced  rotorcraft  issues  such  as  the  ARTI  program 
(Ref.  1),  the  CSRDP  (Ref.  2),  development  of  the  ADOCS  (Ref.  3),  and  on-going  work  to  rewrite  the  rotor- 
craft  handling-qualities  specification  MR-H-8501  (Ref.  4). 

The  SPACES  experiments  grew  primarily  from  the  desire  to  initiate  the  development  of  a  single-pilot 
data  base  for  the  Army's  LHX  program.  Previous  handling-qualities  specifications  data  and  pilot  compensa¬ 
tion  data  were  generated  primarily  in  a  two-crew  context;  that  is,  the  evaluation  pilot  has  been  requested 
to  perform  only  flightpath  management  tasks.  A  single-crew  LHX  pilot  would  have  to  simultaneously  perform 
all  the  flightpath  management  tasks  plus  the  mission  management  tasks  previously  performed  by  the  co-pilot 
or  other  crew  member,  thus  affecting  performance. 

SPACES  I  experiments  were  exploratory  looking  at  20  flight-control  configurations  in  a  single-pilot 
and  a  dual-pilot  mode  to  help  determine  which  combination(s)  were  most  effective  for  tasks  performed.  The 
results  from  the  first  SPACES  experiment  are  reported  in  Haworth,  et  al.  (Refs.  5  and  6).  The  dual-pilot 
evaluations,  with  mission  management  tasks  removed,  served  for  baseline  data  collection  and  for  comparison 
with  single-pilot  ratings  during  SPACES  I.  The  SPACES  II  evaluation  concentrated  on  single-pilot  opera¬ 
tion  using  the  two  best-rated  systems  from  the  SPACES  I  experiment  and  two  additional  control -response 
types.  The  two  additional  response  types  were  thought  to  have  potential  for  single-pilot  operation  based 
on  flight  tests  for  the  proposed  N8501  LHX  Handling  Qualities  Specification  (Ref.  7). 


2.  PURPOSE 

The  primary  purpose  of  the  SPACES  effort  was  the  investigation  of  single-pilot  performance  in  the 
combat  low-level  and  NOE  flight  environment  using  advanced  rotorcraft  cockpit  and  control  law  concepts. 
More  specifically,  these  were  investigations  of  the  effects  of  adding  mission  management  tasks  :o  f  light  - 
path  management  tasks  to  simulate  single-pilot  operations  in  an  advanced  concepts  cockpit. 


3.  FACILITY 

3.1  Vertical  Motion  Simulator 

The  SPACES  investigations  were  conducted  in  the  NASA  Ames  VMS  facility  shown  in  fig.  1.  The  Simula¬ 
tor  has  a  large-amplitude  motion  system  with  six  degrees  of  freedom.  The  VMS  is  capable  of  large  excur¬ 
sions  In  trans lat ional  motion  in  two  of  the  three  axes  (Z  and  either  X  or  Y  depending  on  cab  alignment) 
and  limited  rotational  motion.  The  pilot  cab  is  mounted  on  a  hexipod  which  provides  the  rotational  motion 
and  very  limited  trans  lat  iona )  motion.  The  pod  is  mounted  to  a  carriage  which  is  .?. ,.ed  and  traveH 
along  the  large  horizontal  beam.  A  rack  and  pinion  gear  system  provides  X  or  Y  motion;  and  the  large 
horizontal  beam  is  moved  in  the  l  direction  by  two  large  rams  mounted  under  the  beam. 

3.2  Simulation  Visual  Model 

The  visual  display  consisted  of  a  four-window  CGI  system  (Fig.  2)  utilizing  the  HAC  data  base 
(Ref.  8).  The  HAC  data  base  with  supporting  CGI  models  provided  moving  visual  ground  and  air  threats  for 
combat  realism  and  forced  task  time  lines.  The  primary  visual  ground  threat  was  a  ZSU-23-4  that  was  pro¬ 
grammed  to  follow  up  to  six  paths  through  the  data  base.  The  ZSU-23-4  was  also  programmed  to  acquire  and 
fire  at  the  own  ship  (the  piloted  simulated  helicopter)  following  acquisition  logic  when  line  of  sight 
existed  with  the  own  ship.  The  visual  air-to-air  threat  was  a  HIND-A  helicopter  that  was  modeled  to  fly 
multiple  low-level  flightpath  routes. 
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In  addition  to  threat/targets,  special  effects  were  added  to  the  data  base.  Tracers  were  simulated 
when  the  gun  was  fired,  a  missile  flash  was  simulated  for  missile  launch,  target  hits  were  displayed,  and 
air  defense  artillery  bursts  were  simulated  for  visual  indications  of  enemy  fire.  Own  ship  destruction 
from  weapons  firing  was  indicated  by  graphically  drawn  cracks  on  the  HUD.  Appropriate  sound  cues  were 
coupled  to  the  visual  effects. 

Visibility  was  reduced  to  2  kilometers  at  the  surface  of  the  data  base  with  a  simulated  cloud  ceiling 
at  200  ft  above  the  data-base  floor.  This  simulated  adverse  weather,  and  forced  low-level  air-to-air 
engagements  and  operations.  Wind  and  turbulence  were  also  introduced  during  the  simulation  helping  to 
demonstrate  the  usefulness  of  Earth-referenced  stability  systems  for  low-airspeed  and  hover  tasks. 

3.3.  Advanced  Glass  Cockpit  Hardware 

The  SPACES  glass  cockpit  was  designed  to  emulate  a  limited  number  of  fundamental  augmentation/ 
automation  concepts  for  advanced  rotorcraft.  Prior  ADOCS  experiments  on  automated/augmented  control 
design  and  the  design  of  an  advanced  concepts  cockpit  based  on  LHX/ARTI  cockpit  proposals  served  as  the 
design  framework  and  transition  for  the  SPACES  development.  The  physical  cockpit  design  (Fig.  3)  Incor¬ 
porated  two  CRTs  and  a  HUD,  programmable  switches,  touchscreens,  data-entry  device,  voice  output  system, 
and  side-arm  flight  controllers. 

The  HUD  (an  E&S  Picture  System  One)  was  placed  directly  In  front  of  the  pilot.  The  HUD  visually  over¬ 
laid  90%  of  the  center  CGI  CRT  allowing  the  pilot  to  maintain  visual  contact  outside  the  aircraft  during 
low-level  flight.  Navigation,  caution  indicators,  weapon  status,  and  essential  flight  Information  were 
presented  on  the  HUD  for  single-pilot  operation.  A  line  drawing  of  the  aircraft  and  weapon  stores  remain¬ 
ing  was  shown  on  the  lower  part  of  the  HUO. 

The  upper  13- In .  CRT,  called  the  TSD,  shown  in  Fig.  4,  presented  a  moving  map  display  of  the  HAC  data 
base  and  essential  situational  Information.  Map  Information  included  navigation  routes,  terrain  features, 
cultural  features,  grid  lines,  and  threat  and  friendly  positions.  An  own-ship  helicopter  symbol  was  cen¬ 
tered  on  the  map  and  moved  as  the  aircraft  changed  position  and  heading.  Declutter  features  allowed  the 
pilot  to  remove  unwanted  symbols  and  grid  lines  for  detailed  observations  of  desired  map  areas.  A  zoom 
feature  allowed  the  pilot  to  zoom  In  and  out  from  overhead  as  necessary  for  local  area  viewing,  line-of- 
sight  indication  was  displayed  on  the  moving  map  by  use  of  a  connecting  red  line  between  the  threat  and 
the  own  ship. 

The  lower  9-in.  CRT,  termed  the  MMO,  was  touch  sensitive  for  pilot  interaction.  This  display  pre¬ 
sented  aircraft  and  weapon  status,  system  menu  Items,  situation  reports,  mission  updates,  and  other  needed 
text  information.  The  interactive  screen  on  the  MMD  was  also  used  by  the  pilot  to  update  waypoints  on  the 
TSD.  In  a  degraded  aircraft-system  mode,  the  MMD  displayed  appropriate  checklists  for  pilot  action. 

Other  cockpit  hardware  included  the  programmable  switches,  voice  output  system,  and  data-entry  key¬ 
board.  Twelve  programmable  micro-switches  were  situated  around  the  TSD  to  supplement  the  menu  selections 
found  on  the  MMD  and  allowed  for  discrete  activations  of  aircraft  systems  such  as  the  landing  gear,  weapon 
systems,  and  aircraft  survivability  equipment.  A  voice  recognizer  and  a  personal  speech  system  were 
planned  for  use  for  pilot-voice  input/output  interaction.  Most  of  the  reactive  menu  Items  found  on  the 
MMD  were  programmed  to  be  selectable  with  use  of  the  voice  system,  but  technical  difficulties  and  develop¬ 
mental  time  prevented  use  of  the  input  system.  Voice  output  from  a  Votrax  provided  voice  warnings  and 
caution  messages  along  with  checklist  confirmation  during  routine  and  degraded  operations.  The  data-entry 
device  located  near  the  left  flight  controller  allowed  for  pilot-entered  data-burst  transmissions  for 
tactical  intelligence  and  mission  updates. 

Adjustable  side-stick  controllers  were  mounted  on  both  sides  of  the  pilot  seat.  The  controller  con¬ 
figuration  for  SPACES  was  a  2+1  +  1  limited-displacement  controller  setup  (Mg.  5),  patterned  after  the 
ADOCS  Phase  2  configuration.  The  right-hand  side-stick  force  controller  was  longitudinal  and  lateral 
cyclic  control,  and  the  left-hand  side-stick  force  controller  was  collective.  The  force  pedals  with  small 
displacement  were  used  for  directional  control.  A  trim  button  was  mounted  on  the  top  of  the  right  hand 
controller  during  SPACES  II  for  use  with  the  attitude  stabilization  systems.  A  trigger  release  for  gun 
firing  and  missile  launch  was  mounted  on  the  forward  part  of  the  right-hand  grip.  The  left-hand  control¬ 
ler,  in  addition  to  the  action  bar  for  collective  activation,  had  two  buttons  and  a  proportional  control 
switch  on  top  of  the  grip.  The  upper-left  button  cycled  the  HUD  configurations,  the  upper-right  button 
was  the  switch  to  activate  position  control  laws  and  the  proportional  switch  was  used  to  slew  the  missile 
pod  up  and  down  for  targeting  during  SPACES  II. 

3.4.  Mathematical  Models 

The  mathematical  model  was  the  ARMCOP  10-degree-of-freedom  helicopter  model  configured  as  a  UH-60 
(Refs.  9,10).  The  rotor  model  assumed  rigid  blades  with  rotor  forces  and  moments  radially  Integrated  and 
summed  about  the  azimuth.  The  fuselage  aerodynamic  mode )  used  a  detailed  mode)  representation  over  a 
nominal  angle  of  attack  and  sideslip  range  of  ±15**.  A  simplified  curve  fit  operated  at  large  angles  of 
attack  or  sideslip.  Parameters  from  the  UH-60  were  used  in  the  model  along  with  developed  stabilator 
control  laws. 
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3.5.  Advanced  Digital  Optical  Control  System 

The  flight  control  system  used  for  the  SPACES  was  the  AOOCS  design  with  only  slight  modifications. 
Basically  the  control  system  was  a  model -fol lowing  system  with  feed-forward  shaping  and  feedback.  In  the 
AOOCS  nomenclature,  the  systems  are  referred  to  as  command/stabi 1 ization  but  are  thought  of  as 
command/hold  by  the  research  community.  Two  basic  ADOCS  control -response  types  were  selected  for  SPACES  I 
and  four  for  SPACES  II. 

The  basic  control  laws  for  the  SPACES  I  investigation  were  the  ADOCS  hybrid  control  system  {Table  1) 
and  the  ADOCS  AT/AT  for  both  the  longitudinal  and  lateral  axes.  In  addition  to  the  two  SCAS,  the  follow¬ 
ing  selectable  modes  were  available:  1)  turn  coordination,  2)  heading  rate  command/heading  hold,  3)  alti¬ 
tude  rate  command/altitude  hold,  4)  airspeed  hold  {hybrid  system  only),  and  5)  position  hold  {hybrid  sys¬ 
tem  only).  The  vertical  control  system  consisted  of  a  vertical-acceleration  command/vertical  velocity- 
stabilization  system.  The  yaw  axis  was  a  yaw-acceleration  command/yaw-rate  stabilization  system  for  low- 
speed  and  forward  flight.  The  flightpath  control  configurations  for  SPACES  I  are  listed  in  Table  2. 

SPACES  II  added  two  new  concepts  to  the  test  matrix.  The  additions  were  an  RT/AT  system  patterned 
after  the  ADOCS  system,  but  with  the  hover  hold/position  hold  added  and  a  modification  of  the  AT/AT  sys¬ 
tem.  The  modified  system  was  AT/AT  in  longitudinal  and  RT /AT  in  roll  with  hover  hold/position  hold 
added.  The  SPACES  II  configurations  are  summarized  in  Table  3. 


4.  SUBJECTIVE  DATA  COLLECTION  TECHNIQUES 

Three  subjective  ratings  were  used  during  the  investigations:  1)  The  Cooper-Harper  HQR  scale 
(Ref.  II),  2)  SWAT  (Ref.  12),  used  as  a  technique  to  obtain  workload  ratings  during  the  actual  performance 
of  a  task,  and  3)  The  Weighted  Bipolar  Rating  Technique  developed  at  the  NASA  Ames  Research  Center  to 
record  the  multidimensional  nature  of  mental  workload  (Ref.  13). 

The  SWAT  and  8ipolar  workload  data  collection  was  performed  to  gather  additional  information  that  may 
have  not  been  collected  by  use  of  the  HQR  scale  itself.  Additionally,  the  ratings  were  collected  to 
determine  the  correlation  between  the  three  scales  and  usefulness  of  the  scales  as  workload  measures. 


5.  CONDUCT  OF  THE  EXPERIMENT 
5.1.  General 

Army  engineering  test  pilots  participated  in  the  SPACES  experiments.  The  pilots  flew  identical 
control  configurations  and  performed  the  same  flightpath  management  tasks  in  both  the  dual-  and  single¬ 
pilot  role  for  SPACES  I.  An  experienced  Army  aviator  in  the  simulation  control  room  montoring  the  cockpit 
and  CGI  visual,  acted  as  the  second  crew  member  and  conducted  mission  management  functions  (co-pilot 
duties)  for  the  dual  pilot  setting  for  SPACES  .  The  simulator  pilot  in  the  dual-pilot  context  operated 
as  the  flightpath  manager  maintaining  flightpath  control  of  the  simulated  vehicle  similar  to  traditional 
handling  qualities  investigations. 

Only  the  single-pilot  operation  was  investigated  in  SPACES  II.  For  single-pilot  operation  in  both 
investigations,  the  simulation  pilot  was  required  to  perform  both  flight  path  management  and  mission  man¬ 
agement  tasks.  This  included  flight  maneuvering  plus  concurrent  operation  on  a  tactical  communications 
network  (Fig.  6),  navigation,  threat  avoidance  and  countermeasures ,  selection  of  firing  points,  planning 
of  engagement  tactics,  and  weapons  selection  and  firing. 

5.?.  Scenario 

The  basic  mission  scenario  (Fig.  7)  was  to  depart  a  forward  refueling  point  and  fly  a  series  of  way- 
points  (while  evading  threat  detection  and  engagement)  to  arrive  at  a  firing  position,  and  then  perform 
reconnaissance  and  subsequent  air-to-ground  attack  tasks.  After  the  ground  engagement  and  damage  assess¬ 
ment,  the  pilot  was  informed  of  a  threat  helicopter  penetration  which  led  to  an  air-to-air  engagement  with 
the  threat  helicopter.  During  these  activities,  the  crew  was  also  occupied  with  communications,  naviga¬ 
tion,  reconnaissance,  targeting,  aircraft  survivability  equipment  (ASE)  and  ether  related  mission  manage¬ 
ment  tasks. 

Operation  in  the  total  scenario  was  approximately  20  minutes  in  length.  Way  points,  threat  aircraft 
routes,  communications,  and  the  threat  laydown  were  varied  at  the  end  of  each  run  to  reduce  learned 
responses  for  single  pilot  operation. 

5.3.  Data  Col  lection 

Data  collection  was  divided  into  four  scenario  phases:  1)  NOE  low-level  flight,  ?)  hovering  recon¬ 
naissance,  3)  air-to-ground  attack,  and  4)  air-to-air  engagement.  The  phases  were  designed  to  coincide 
with  specific  flight  tasks  maneuvers  such  as  precision  hover,  bob-up  and  boh-dow  ..  Cooper-Harper  HQRs  and 
SWAT  ratings  were  obtained  from  the  pilot  for  the  specified  maneuvers  at  the  completion  of  each  scenario 
phase.  Bipolar  workload  ratings  were  collected  after  all  daily  scenario  phases  were  completed.  Each  of 
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the  above  scales  are  designed  to  measure  pilot  compensation  and  workload.  Specific  statistical  Informa¬ 
tion  was  obtained  at  the  end  of  each  scenario  run. 


6.  RESULTS 

The  ratings  obtained  during  dual-pilot  operation  signify  performance  of  distinct  flightpath  manage¬ 
ment  tasks.  Ratings  from  single-pilot  operation  represent  the  result  of  Imposing  mission  management  tasks 
onto  the  flightpath  management  tasks.  SWAT  and  bipolar  ratings  and  figures  are  specifically  contained  in 
pilot-workload  analysis  section  of  this  paper. 

6.1.  Nap-of-t.'ie-Earth/Low-Level  Flight 

For  consistent  task-measure  comparison,  dual-pilot  ratings  were  gathered  on  a  portion  of  a  familiar 
low-level  course  where  the  pilot  was  instructed  to  maintain  60  +5  KIAS  and  a  variable  altitude  of  50  ft  or 
less  AGL.  Single-pilot  ratings  were  given  for  low-level  flight  routes  at  60  ±5  KIAS  while  the  pilot  per¬ 
formed  mission  management  tasks  such  as  navigation,  navigation  update,  communications,  and  use  of  threat 
countermeasures.  Average  single  and  dual  pilot  HQRs  for  selected  AOOCS  control  systems  for  SPACES  I 
and  11  are  presented  In  Fig?.  8,  9,  and  10. 

When  comparing  all  dual-pilot  and  single-pilot  HQRs  obtained  during  SPACES  I  for  HOE  flight,  the 
single-pilot  ratings  averaged  2.2  ratings  worse  than  dual-pilot  ratinqs  overall,  indicating  degraded 
flightpath  performance  and  higher  pilot  workload.  Only  configuration  HB  with  AT/VH  In  pitch  and  RT/AT  in 
roll  received  satisfactory  handling  qualities  (HQRs  less  than  3.5  are  considered  satisfactory  of  Level  1) 
for  single-pilot  operation  in  the  low-level  environment.  All  10  of  the  hybrid  configurations  flown  "dual" 
received  satisfactory  ratings.  Configuration  HB  was  the  best  rated  ADOCS  hybrid  system  with  altitude 
hold,  and  turn  coordination  In  forward  flight. 

Altitude  hold  appeared  to  be  significant  for  reducing  workload  and  HQRs  during  the  SPACES  I 
studies.  The  altitude  hold  feature  was  common  to  the  better  rated  configurations  and  served  to  reduce 
pilot  compensation  and  workload  by  providing  vertical  terrain  avoidance.  It  is  predicted  that  terrain/ 
obstacle  avoidance  In  the  lateral  direction  if  Implemented  will  most  likely  result  in  further  reduction  of 
workload. 

For  the  SPACES  II  simulation,  the  same  configuration  as  reported  in  SPACES  I  with  AT/VH  in  pitch  and 
RT/AT  In  roll  received  satisfactory  (Level  1)  average  pilot  ratings.  For  a  similar  system  (AT /AT)  without 
velocity  hold  In  pitch  but  with  RT/AT  in  roll,  the  average  rating  was  Level  2,  but  close  to  the  Level  1 
limit.  The  configurations  with  RT/AT  or  AT/AT  in  both  pitch  and  roll  were  solidly  Level  2.  This  verifies 
results  obtained  in  SPACES  I  that  velocity  hold  Is  Important  for  single-pilot  NOE,  low-level  constant- 
airspeed  flight  modes.  The  same  requirement  does  not  exist  for  dual -pi lot  modes  with  the  pilot  acting 
only  as  the  flightpath  manager. 

6.2.  Alr-to-Ground  Engagement 

The  air-to-ground  engagement  occurred  In  hovering  unmasked  flight.  In  the  dual-pilot  situation,  the 
pilot  received  and  followed  Instructions  from  the  co-pi  lot/researcher  as  to  the  attack  position,  target 
identification,  azimuth  pointing,  selection  of  weapon,  target  acquisition,  and  when  to  fire.  The  single 
pilot  performed  the  above  tasks,  including  communications  without  the  aid  of  a  second  crewmember.  The 
specific  targeting  flight  task  was  to  maintain  an  unmasked  hover  altitude  in  line  of  sight  of  the  ground 
target,  slew  in  the  direction  of  the  target,  overlay  the  HUO  sighting  reticle  on  the  target  within  ±1°  for 
1  sec,  and  then  maintain  the  target  within  +3°  of  the  reticle  for  an  additional  2  sec.  HUD  symbolot  ' 
changes  and  audio  tones  indicated  when  lock-on  and  launch  parameters  were  met.  If  line  of  sight  existed 
with  the  ZSU-23-4  ground  tar  ct  for  a  specified  amount  of  time  after  unmasking,  the  ownship  was  fired  upon 
and  hit  resulting  in  forced  time  lines  for  target  acquisition  similar  to  real-world  considerations. 

For  SPACES  I  (Fig.  11)  the  average  differential  in  HQRs  between  single-  and  dual-pilot  conditions 
were  slightly  more  than  one  half  of  a  rating  point  with  the  single-pilot  condition  being  higher 
(degraded).  This  general  trend  probably  reflected  that  the  targeting  task  could  not  be  completely  off¬ 
loaded  from  the  pilot  in  the  dual-pilot  situation,  and/or  that  the  given  display  features  of  the  cockpit 
enabled  the  pilot  to  perform  the  task  faster  and  better  without  the  interference  of  verbal  crewmember 
input.  Three  control  configurations  in  SPACES  I  were  rated  satisfactory  for  dual-pilot  operation  in  the 
air-to-ground  attack  task  as  presented  in  Fig.  11.  These  were  configurations  AG,  AH,  and  HB  with  config¬ 
uration  HB  receiving  the  best  average  HQR  of  2.4.  Each  of  the  Level  1  dual-pilot  configurations  had  two 
features  In  common:  altitude  hold  and  heading  hold.  Configuration  HB  was  the  only  configuration  that 
received  average  Level  1  ratings  in  both  the  dual-pilot  and  single-pilot  conditions  for  the  air-to-ground 
engagement  task.  The  lowered  ratings  for  the  HB  configuration  were  probably  due  in  part  to  the  position 
hold  feature  which  is  a  element  of  that  configuration.  Since  the  ground-attack  task  for  SPACES  I  was 
essentially  one  of  bob-up  and  stabilizing  on  the  target,  the  position  hold  feature  was  considered  an 
enhancing  feature. 

The  SPACES  II  air-to-ground  attack  maneuvers  were  generally  more  dynamic  than  SPACES  I.  In  SPACES  I 
the  threat  location  on  the  moving  map  display  was  constantly  updated  and  the  pilot  was  able  to  plan  firing 
locations.  During  SPACES  II  the  threat  location  was  not  indicated  on  the  moving  map  display  until  line  of 


sight  existed  with  the  threat.  Once  line  of  sight  existed  the  pilot  dynamically  maneuvered  to  avoid 
acquisition  and  lock  on  while  positioning  to  target  the  threat. 

The  results  of  the  ground-attack  phase  for  SPACES  II  are  presented  in  Fig.  12.  Only  the  RT/AT 
response-type  received  Level  1  average  ratings.  These  results  suggest  that  the  attitude  response-type 
(especially  in  combination  with  velocity  hold)  causes  a  degradation  in  handling  qualities  for  the  ground- 
attack  task.  Since  the  task  involved  precision  pointing,  the  velocity  hold  function  operated  to  readjust 
attitude  to  maintain  groundspeed  by  commanding  pitch  and  roll  attitude  changes,  in  direct  opposition  to 
the  pilot's  need  for  an  attitude-stabilized  platform.  Both  the  AT/AT  and  RT/AT  response-types  produced 
attitude  changes  in  direct  proportion  to  cyclic  commands,  with  some  slight  variation  due  to  gust  rejection 
with  a  good  ability  for  precise  pointing.  The  RT/AT  was  more  attractive  than  AT /AT  probably  because  of 
the  requirements  for  larger  control  inputs  to  maneuver  and  the  fact  that  a  constant  control  force  is  not 
required  to  maintain  the  selected  attitude  with  the  RT/AT  system. 

6.3.  Hovering  Flight  (Reconnaissance) 

After  the  pilot  completed  the  battle-damage  reconnaissance  of  a  specified  target  area  he  was 
required,  while  at  a  hover  to  send  a  data-burst  transmission  to  update  the  tactical  situation.  This 
forced  the  pilot  to  maintain  hovering  flight  and  to  respond  to  data-entry  prompts  on  the  TSD  by  using  the 
keyboard  near  the  pilot's  left  hand.  During  SPACES  I  only  the  ADOCS  hybrid  system  with  shown  options  for 
hover  received  acceptable  or  satisfactory  ratings  as  shown  in  Fig.  13.  The  overwhelming  option  for  favor¬ 
able  pilot  comments  was  the  position  hold  feature  especially  with  wind  and  turbulence  present. 

One  major  conclusion  of  the  SPACES  I  simulation  was  that  the  AT/AT  response-type  was  unsatisfactory 
for  the  hovering  task,  while  the  AT/VH  response- type,  with  position  hold,  was  satisfactory  (Level  1). 

There  was  no  evaluation  In  SPACES  I  of  an  AT/AT  response-type  with  position  hold.  For  SPACES  II,  such  a 
system  was  developed.  In  addition,  the  RT/AT  case  was  evaluated  both  with  and  without  position  hold  during 
SPACES  II. 

The  position  hold  feature  implemented  on  the  ADOCS  flight  control  system  and  evaluated  during 
SPACES  I  was  slightly  modified  for  SPACES  II:  the  range  for  engagement  was  increased  from  3  knots  to 
5  knots  groundspeed.  In  both  simulations,  position  hold  disengaged  whenever  the  pilot  applied  more  than 
one-half  pound  of  force  on  the  cyclic.  When  the  pilot  released  the  stick  after  the  groundspeed  was 
reduced  below  5  knots,  the  position  hold  system  would  reengage.  Figure  14  rhows  the  influence  of  position 
hold  on  pilot  ratings  for  the  SPACES  II  hover  task.  Tt  is  evident  that  all  of  the  response-types  were 
solidly  Level  2  when  position  hold  was  not  available  thus  verifying  the  results  from  SPACES  I.  For  preci¬ 
sion  hover,  position  hold  is  required  for  Level  1  HQRs  in  the  single  pi  1 ot  condition  when  mission  tasking 
is  imposed. 

6.4.  Air-to-Air  Engagements 

Air-,  -air  engagements  were  started  from  an  OGE  hover  "ambush  point."  The  air-to-air  target  was  a 
th^r/  ,, allcopter  that  flew  varying-programmed  low-level  routes,  maneuvers,  and  airspeeds.  The  initial 
engagement  was  normally  attempted  with  the  simulated  air-to-air  missile.  As  the  range  to  the  air  threat 
decreased,  the  pilot  was  allowed  to  select  the  fixed-gun  system  because  of  the  increased  maneuvering 
activity.  The  change  over  to  the  fixed  gun  system  occurred  when  the  pilot  felt  he  could  no  longer  obtain 
the  necessary  missile  launch  constraints  (same  as  air- to-ground  engagement).  For  dual-pilot  simulations, 
the  experimenter/co-pi lot  gave  the  pilot  specific  ocations  and  tracking  information  for  the  threat  heli¬ 
copter  until  the  air-to-air  engagement  became  dynamic  enough  that  the  co-pilot  was  unable  to  aid  the 
pilot.  During  single-pilot  engagements,  the  pilot  was  only  given  the  general  location  of  the  helicopter 
threat  via  ground  and  air  communications,  requiring  the  pilot  to  acquire  the  air  target  without  the  aid  of 
a  co-pi  lot . 

During  the  SPACES  I  simulation,  the  average  range  for  successful  missile  engagement  was  2328  feet 
with  average  range  for  successful  gun  engagement  approximately  one  half  of  that  distance.  Air-to-air 
engagements  normally  lasted  less  than  20  sec  after  establishing  pilot  1 ine-of-sight  with  the  target. 
Attitude  command/attitude  stabilization,  configuration  AH  with  heading  hold  and  altitude  hold  (Fig.  16), 
was  rated  satisfactory  for  missile  and  gun  engagements  for  both  dual-  and  single-pilot  conditions.  When 
the  hybrid  configuration  HA  system  was  simulated,  all  pilots  successfully  engaged  the  threat  helicopter 
with  air-to-air  missile  system  without  reverting  to  the  fixed  gun  even  though  this  configuration  received 
level  2  rating  for  the  single-pilot  condition.  The  average  difference  in  HQRs,  between  single  pilot  and 
dual  pilot,  showed  the  sinqle-pilot  handling  qualities  being  only  slinhtly  degraded.  The  air-to-air 
engagement  task  was  primarily  a  single-pilot  task,  because  of  the  required  maneuver  dynamics,  targeting 
information  presented  on  the  pilot  displays  and  short  target -acqui si tlon  times.  Once  the  air-to-air 
threat  was  presented,  all  other  mission  tasking  was  Ignored  while  the  pilots  in  both  the  dual-  and  single¬ 
pilot  conditions  concentrated  on  the  target  and  HUD.  For  the  SPACFS  II  simulation,  the  results  (Fig.  16) 
show  that  the  RT/AT  response-type  was  preferred  by  pilots  over  the  attitude  system*  for  the  same  reasons 
stated  in  the  air-to-ground  section  of  this  paper. 

6.5.  Pilot  Workload  Analysis 

Both  SWAT  and  the  NASA  bipolar  workload  techniques  revealed  a  higher  level  of  pilot  workload  for  the 
single-pilot  configuration  than  the  dual-pilot  configurations  as  shown  in  Fig.  17.  The  techniques  also 
distinguished  between  control  configurations  and  shewed  differences  between  segments  In  the  single-pilot 
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configuration.  However,  neither  technique  showed  significant  differences  between  segment  tasks  in  the 
two-pilot  arrangement.  This  Indicated  that  the  addition  of  a  second  crew  member  served  to  smooth  out 
workload  peaks  and  thereby  reduced  the  differences  between  the  workload  of  the  flight  segments.  In 
reviewing  the  results  and  similarity  between  the  SWAT  and  Bipolar  subjective  workload  techniques,  the 
correlation  between  the  two  Is  significant  at  R  =  0.67.  As  expected  both  techniques  were  significantly 
correlated  to  the  Cooper -Harper  HQRs  at  R  =  0.75  and  R  =  0.79,  respectively  for  the  Bipolar  and  SWAT. 

Differences  between  dual-  and  single-pilot  ratings  on  all  scales  were  relatively  small  for  both  the 
air-to-air  and  air-to-ground  engagements  as  found  with  the  HQRs.  The  above  tasks,  although  aided  by  the 
co-pilot/experimenter  In  the  dual-pilot  condition,  were  essentially  single-pilot  tasks  because  of  the 
short  time  line  for  crew  coordination,  nature  of  the  targeting  task,  and  aovanced  cockpit  Informational 
presentation  that  supplied  visual  targeting  indications  to  the  pilot. 


7.  CONCLUSIONS 


7.1.  General 

As  predicted,  superimposing  mission  management  tasks  on  flightpath  management  tasks  result  in 
degraded  pilot  HQRs  and  higher  pilot  compensation  and  workload.  Because  of  the  close  proximity  of 
obstructions  In  the  low-level  and  NOE  flight  environment,  constant  flightpath  supervision  Is  required. 

The  addition  of  mission  management  tasks  further  increases  pilot  attentional  demands,  contributing  to 
operator  overload  and  reduced  flightpath  performance.  Handling  quality  rating,  SWAT,  and  bipolar  measures 
were  sensitive  to  differences  in  pilot  compensation  and  performance  between  the  single-pilot  and  dual¬ 
pilot  conditions  and  between  single-pilot  task  segments.  Significant  differences  did  not  exist  between 
task  segments  in  the  dual-pilot  condition  since  the  addition  of  the  second  crewmember  smoothed  out  work¬ 
load  peaks. 

7.2 .  Nap-of-the-Eartb/Low-Level  Flight 

1)  Airspeed  hold  was  preferred  over  attitude  hold  in  NOE/low-level  flight.  However,  this  probably 
reflected  the  task  constraint  requiring  the  pilots  to  maintain  a  constant  airspeed  for  consistent  task 
measure  comparison.  Holding  constant  airspeed  is  more  reflective  of  low-level  flight  than  of  NOE  dynamic 
maneuvering  in  which  airspeed  is  constantly  varied. 

2)  Altitude  hold  was  also  significant  in  reducing  pilot  compensation  during  NOE  low-level  flight. 
Altitude  hold  allowed  the  use  of  the  pilot's  left  hand  for  mission  tasks  and  provided  limited  vertical 
terrain  avoidance,  especially  when  the  pilot  was  unable  to  constantly  monitor  altitude  as  a  consequence  of 
mission  tasks.  It  is  predicted  that  the  addition  of  lateral  terrain/obstacle  avoidance  system  would 
further  produce  a  reduction  in  piloting  workload  for  NOE  flight  traveling. 

3)  The  use  of  a  rate  comnand/ attitude  hold  control  response-type  should  be  further  investigated  for 
use  in  the  NOE  maneuver  environment  where  the  pilot  is  not  constrained  by  holding  constant  airspeed. 
Observations  made  during  SPACES  II  indicated  that  rate  command /attitude  hold  may  be  a  preferable  system 
for  the  NOE  dynamic  flight  when  combined  with  limited  displacement  side-arm  flight  controllers. 

4)  Attitude  command/velocity  hold  in  pitch,  combined  with  rate  command/attitude  hold  in  roll  for 
bank-angle  hold  was  considered  satisfactory  for  single-pilot  low-level  flight  under  the  conditions  tested. 

5)  Turn  Coordination  in  forward  flla^t  at  60  knots  was  also  considered  enhancing  especially  when 
combined  with  the  rate  command/attitud  .Id  in  roll. 

7.3.  Air-to-Air  and  Alr-to-Ground  Engagements 

1)  For  both  air-to-air  and  air-to-ground  engagements,  the  differences  between  dual-  and  single-pilot 
HQR,  SWAT,  and  Bipolar  ratings  were  relatively  small,  with  single-pilot  ratings  slightly  higher.  Time 
lines  were  forced  because  the  ground  threat  could  destroy  the  own  ship  and  because  of  the  active  presenta¬ 
tion  of  the  air  threat.  This  caused  the  pilot  to  primarily  pilot  the  vehicle  and  shed  non-essential  mis¬ 
sion  tasking  to  concentrate  on  destroying  the  threat. 

2)  Rate  command/attitude  hold  was  preferable  over  attitude  conmand/attitude  hold  for  low-speed  preci¬ 
sion  pointing  tasks  for  air-to-air  and  air-to-ground  attack. 

3)  The  air-to-air  engagement  was  dynamic,  lasting  on  the  average  of  20  sec.  One  of  the  greatest 
piloting  challenges  was  to  maintain  aircraft  alignment  with  the  target  to  meet  the  constraints  for  missile 
launch.  In  the  simulated  low-level  terrain  environment  targets  were  difficult  to  acquire  at  the  longer 
ranges  desired  for  missile  launch.  Missile  engagements  were  further  hampered  when  the  pilot  was  required 
to  Identify  the  aircraft  as  friend  or  foe. 


7.4.  Hovering  Flight 


For  precision 
required  for  Level 
effect  as  recorded 
environment  drives 


hover,  hover  hold  with  position  hold,  which  includes  altitude  and  heading  hold,  is 
1  single-pilot  handling  qualities.  Addition  of  a  second  crew  member  has  a  similar 
during  SPACES  I.  As  In  NOE  flight,  the  close  proximity  of  objects  in  the  immediate 
the  need  for  a  precision  hover  capability.  When  the  single  pilot  Is  required  to 


accomplish  more  than  flightpath  tasks  the  ability  to  maintain  precision  hover  decreases,  thus  increasing 
the  need  for  hovering  flight  stabilization. 

7.5.  Workload  Analysis 

The  workload  analysis  showed  that  single-pilot  workload  was  higher  than  dual  pilot  at  the  conditions 
tested.  The  SWAT  and  Bipolar  workload  techniques  also  distinguished  between  control  configurations  and 
showed  significant  differences  between  segments  for  the  single-pilot  case.  The  correlation  between  the 
two  workload  techniques  was  significant  at  R  =  0.67.  Both  workload  techniques  were  significantly  corre¬ 
lated  to  the  Cooper-Harper  HQRs  at  R  =  0.75  and  0.79»  respectively,  for  bipolar  and  SWAT  indicating  the 
sensitivity  of  the  handling  qualities  scale  for  measuring  decreased  task  performance  with  increased 
work  load. 

A  number  of  factors  must  be  considered  in  weighing  the  importance  of  these  conclusions: 

1)  The  data  comes  from  a  moving,  ground-based  simulation.  It  is  important  that  the  results  be  veri¬ 
fied  in  a  flight-test  program. 

2)  Hover  hold  as  simulated  was  probably  more  accurate  than  current  technology  allows. 

3)  Pilot  learning  and  transfer  effects  were  predicted  because  of  the  complexity  and  unique  tasking 
nature  of  the  simulation.  To  counter  the  learning  and  transfer  effect,  a  randomized  block  design  was 
used.  Randomization  of  conditions  will  increase  data  scatter;  however,  the  measures  of  central  tendency 
will  remain  valid.  Since  cognitive  load  tasking  also  influences  the  pilot  ratings  especially  in  the 
single-pilot  situation,  the  pilot  was  not  allowed  to  practice  the  same  run  several  times  prior  to  data 
collection.  This  caused  the  data  as  predicted  to  have  more  scatter  when  compared  to  typical  handling- 
quality  evaluations  in  which  the  same  task  configuration  is  practiced  several  times  before  a  rating  is 
obtained.  The  obtained  performance  rating  in  the  SPACES  conditions  may  be  more  typical  of  actual  world 
performance  and  pilot  compensation  since  the  pilot  has  not  recently  practiced  the  same  task. 
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TABLE  1 

ADOCS  HYBRID  CONTROL  SYSTEM  —  SPACES  I 


LONGITUDINAL 

PITCH  ATTITUDE  COMMAND/GROUNDSPEED 
STABILIZATION  FOR  LOW  SPEED  AND  PITCH  ATTITUDE 
COMMAND/AIRSPEED  STABILIZATION  AT  HIGH  SPEED. 
IAT/LV  -  AT/A S) 

LATERAL 

ROLL  ATTITUDE  COMMAND/GROUND  SPEED 
STABILIZATION  FOR  LOW  SPEED  AND  ROLL  RATE 
COMMAND/ROLL  ATTITUDE  STABILIZATION  AT  HIGH 
SPEED.  (AT/LV  -  RT/AT) 

VERTICAL 

VERTICAL  ACCELERATION  COMM  AND/VERTICAL 
VELOCITY  STABILIZATION  FOR  LOW  SPEED  AND  FOR 
FORWARD  FLIGHT. 

YAW 

YAW  ACCELERATION  COMMAND/YAW  RATE 
STABILIZATION  FOR  LOW  SPEED  AND  YAW 
ACCELERATION/YAW  RATE  FOR  FORWARD  FLIGHT. 

TABLE  2 

FLIGHT  PATH  CONTROL  CONFIGURATIONS  —  SPACES  I 


SELECTABLE  SCAS  MODES 
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PITCH/ROLL 

B 
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D 
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TURN 
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HEADING 

HOLD 
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X 

X 

X 
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TABLE  3 

FLIGHT  PATH  CONTROL  CONFIGURATIONS  —  SPACES  II 


VERTICAL  SCAS 

-  RATE  COMMAND/ALTITUDE  HOI  " 

YAW  SCAS 

-  YAW  RATE  COMMAND/HEADI  IMG  HOLD 


LONGITUDINAL  AND  LATERAL  CONTROL  SCAS 


PITCH 

ROLL 

SELECTABLE  SCAS  MODES 

TURN 

HEADING 

ALTITUDE 

POSITION 

AIRSPEED 

COORD. 

HOLD 

HOLO 

HOLD 

HOLD 

HYBRIO 

X 

X 

X 

X 

X 

AT/AT 

X 

X 

X 

0 

0 

AT/ AT 

RT/AT 

X 

X 

X 

X 

0 

RT/AT 

X 

X 

X 

X 

0 

•HYBRID  1 

- 

0 

X 

vv  o  HH 

- 

•HYBRID -2 

- 

X 

X 

0 

- 

•HOVER  AND  LOW  SPEED  ONLY 
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CALL  SIGN 

VOICE 
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CAPTAIN 
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1 
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3 

FM 
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GROUND 
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4 

FM 

36.6 
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UNIT 

EB53D 

5 

FM 
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TA59C 

6 
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SIMULATED  COMMAND  NET  INTERFACE 


fig.  6  Simulated  command  net  interface  and  voice/command  sceanrio. 
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Fig.  8  SPACES  I — NOE  flight  task  at  60  K I  AS :  AT/AT  control  system. 
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Fig.  9  SPACES  I— NOE  flight  task  at  60  KIAS:  hybrid  control  system. 
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Fig.  10  SPACES  1 1- -NOE  flight  at  60  knots 
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Fig.  11  SPACES  I— Air-to-ground  attack. 
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Fig.  12  SPACES  JI --Air-to-ground  attack. 
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Fig.  13  SPACES  I— Hover  task  with  single  pilot. 
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Fig.  14  SPACES  Il--llover  and  transmit  status  report  (single  pilot). 
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Fig.  15  SPACES  1 --A ii -to-ai r  engagement  task. 
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Fig.  16  SPACES  11 --Air-to-air  attack. 
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Fig.  17  SPACES  I--N0E  flight  task  (bipolar  ratings):  single  and  dual  pilot. 
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